-- Logs begin at Sun 2022-08-07 17:32:43 UTC, end at Sun 2022-08-07 18:40:22 UTC. -- Aug 07 18:06:07.297196 dv-cinder-849846-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 18:06:07.304361 dv-cinder-849846-9-smb devstack@keystone.service[80159]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 18:06:07 2022] *** Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: nodename: dv-cinder-849846-9-smb Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: machine: x86_64 Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: clock source: unix Aug 07 18:06:07.306427 dv-cinder-849846-9-smb devstack@keystone.service[80159]: pcre jit disabled Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: detected number of CPU cores: 4 Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: current working directory: / Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: detected binary path: /usr/bin/uwsgi-core Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: your processes number limit is 47680 Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: your memory page size is 4096 bytes Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: detected max file descriptor number: 2048 Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: lock engine: pthread robust mutexes Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: thunder lock: enabled Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 18:06:07.306860 dv-cinder-849846-9-smb devstack@keystone.service[80159]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 18:06:07.348159 dv-cinder-849846-9-smb devstack@keystone.service[80159]: Python main interpreter initialized at 0x55b45d2089c0 Aug 07 18:06:07.348159 dv-cinder-849846-9-smb devstack@keystone.service[80159]: python threads support enabled Aug 07 18:06:07.348159 dv-cinder-849846-9-smb devstack@keystone.service[80159]: your server socket listen backlog is limited to 100 connections Aug 07 18:06:07.348159 dv-cinder-849846-9-smb devstack@keystone.service[80159]: your mercy for graceful operations on workers is 90 seconds Aug 07 18:06:07.348544 dv-cinder-849846-9-smb devstack@keystone.service[80159]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 18:06:07.348652 dv-cinder-849846-9-smb devstack@keystone.service[80159]: *** Operational MODE: preforking *** Aug 07 18:06:07.348897 dv-cinder-849846-9-smb devstack@keystone.service[80159]: *** uWSGI is running in multiple interpreter mode *** Aug 07 18:06:07.348897 dv-cinder-849846-9-smb devstack@keystone.service[80159]: spawned uWSGI master process (pid: 80159) Aug 07 18:06:07.349102 dv-cinder-849846-9-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 07 18:06:07.350034 dv-cinder-849846-9-smb devstack@keystone.service[80159]: spawned uWSGI worker 1 (pid: 80166, cores: 1) Aug 07 18:06:07.350034 dv-cinder-849846-9-smb devstack@keystone.service[80159]: spawned uWSGI worker 2 (pid: 80167, cores: 1) Aug 07 18:06:07.350185 dv-cinder-849846-9-smb devstack@keystone.service[80159]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 18:06:12.856332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:12.856332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: from cryptography.utils import int_from_bytes Aug 07 18:06:12.857870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:12.857870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: from cryptography.utils import int_from_bytes Aug 07 18:06:12.858061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:12.858061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: from cryptography.utils import int_from_bytes Aug 07 18:06:12.858495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:12.858495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: from cryptography.utils import int_from_bytes Aug 07 18:06:12.907099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 18:06:12.907284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 18:06:12.907460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] command line args: [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 18:06:12.907625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 18:06:12.907709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 18:06:12.907820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 18:06:12.907908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ================================================================================ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 18:06:12.908012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] command line args: [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 18:06:12.908116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] admin_token = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.908283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 18:06:12.908368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config_dir = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.908464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ================================================================================ {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 18:06:12.908554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.908726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config_source = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.908810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] admin_token = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.908905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] debug = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.908982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] config_dir = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] config_source = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] debug = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.909893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_config_append = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.910988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_dir = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_config_append = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_dir = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_file = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.911974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.912971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.913928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.914969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] publish_errors = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] publish_errors = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.915909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] standard_threads = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] standard_threads = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.916986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_journal = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_json = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_stderr = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_syslog = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] use_journal = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] use_json = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.917919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] use_stderr = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.918033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.918110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] use_syslog = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.918269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.918345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:12.918523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.918602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.918757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.918841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.919001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.919177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.919864 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.919986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.920993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.921946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.922978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.923891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.924933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.925841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.926882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.927846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.928935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.929930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.930997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.931923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.932981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.933900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.934854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.935889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.936975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.937996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.938907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.939859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.940956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.941946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.942872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.943897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.external = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.external = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.944923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.password = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.token = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.password = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] auth.token = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.945930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.946888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.947880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.948860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.949859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.950016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.950149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.950285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.951944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.952951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.953925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.954981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.955883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.956863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.957947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.958918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.959848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.960988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.961942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.962893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.963965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.964942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.965830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.966021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.966699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.966839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.966993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.967213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.967340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.967476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.967601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.967727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.967874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.968916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.969957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.970977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.971872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.972966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.973980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974750 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.974876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.975909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.976917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.977821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.978963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.979996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.980958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.981886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.982988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.983880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] role.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.984948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] role.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.985944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.986925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.987958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.988856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.989844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.990979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.991912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.992884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.993976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.994055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.994207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.994286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.994367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 18:06:12.994447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.994698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.994937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.995182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.995429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.995678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.995916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.996156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.996394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.996678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.996932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.997198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.997564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.997865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.998137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.connection = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.998386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.998636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.998876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.999118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.999356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.999592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:12.999828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.000064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.000308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.000543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.000814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.001052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.001303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.001538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.001783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.002016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.002257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.002494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:13.002665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 18:06:13.024526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.024780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.025259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.028210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.028507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.029462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.035423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.039267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.063377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.063542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.065526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.065763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.115833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.116034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.166598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.166819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.167084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.167321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.231268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.231489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.231654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.231832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.231980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.232703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.255173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.255399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.255556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.255655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.255792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.255876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.256979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.267958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.268612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.280925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.281988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.282080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.282197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.282281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.282412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.282628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.282843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80166) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:13.299770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.299977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:13.300098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.300310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:13.300391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.300505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:13.300690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.300808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.300890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:13.301070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.301163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.301328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.301418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.301584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.301665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.301901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.313930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.314134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.320723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.321120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.323733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.324017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.324167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.324300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.324455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.324602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.324767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.324888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.325055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.325136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.325896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.326927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.327115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.327195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.327395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.327669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.349739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.350686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.351202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.351485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.352172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.352479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.356153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.356438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.356767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.357377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.357668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.357957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.363370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.363658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.364618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.364912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.367703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.367992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.368285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.368592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.368872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.368964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.369169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.369252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.369439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.369546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.369721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.369842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.370122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.370424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.370710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.370997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.386069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.386350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.387304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.387588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.390920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.392189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.394047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.394343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.395367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.395670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.398694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.400304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.402115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.403525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.405644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.405946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.406230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.406521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.406742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.406825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.407046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.407136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.407346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.407638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.407920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.408203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.423054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.423343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.423609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.423872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.424129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.424420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.424727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.424997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.430769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.431924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.432322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.432620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.433519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.433802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.436306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.436700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.436997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.437181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.437283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.437470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.437550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.437778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.438072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.438356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.448847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.449133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.449418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.449699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.449789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.449990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.450069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.450275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.450963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.451118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.451292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.451403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.451682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.451960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.467695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.468612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.470635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.471573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.473555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.474534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.475111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.476120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.476584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.476889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.477172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.477641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.477930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.478227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.483524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.484819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.485153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.486421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.488032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.488322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.488632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.488913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.489388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.489685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.489982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.490275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.496837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.497125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.497920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.498844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.499136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.499420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.504904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.505188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.505469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.505747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.506019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.506272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80166) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:13.506356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.506558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.506640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.506834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.506919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.507944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.508076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.508238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.508320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.508580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.508664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.508913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.509191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.509464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.509744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.510008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80166) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:13.542463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b45d2089c0 pid: 80167 (default app) Aug 07 18:06:13.543872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b45d2089c0 pid: 80166 (default app) Aug 07 18:06:13.545806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f618a0-ba42-4e48-9825-a73aab427e78 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:13.546087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f618a0-ba42-4e48-9825-a73aab427e78 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:13.546357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f618a0-ba42-4e48-9825-a73aab427e78 None None] PATH_INFO: `/v3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:13.550624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Sun Aug 7 18:06:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:21.282215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:21.282775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:21.282775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:21.287136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:21.292612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:21.293049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:21.293166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:21.365365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: INFO dbcounter [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] Registered counter for database keystone Aug 07 18:06:21.384878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG oslo_db.sqlalchemy.engines [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 18:06:21.391269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writer thread running {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 18:06:21.569916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG passlib.handlers.bcrypt [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80167) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 18:06:21.570249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG passlib.handlers.bcrypt [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80167) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 18:06:21.624283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:21.625915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:21.757056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 07 18:06:21.922869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:21.996313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: INFO dbcounter [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] Registered counter for database keystone Aug 07 18:06:22.020298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG oslo_db.sqlalchemy.engines [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 18:06:22.026701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writer thread running {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 18:06:22.149155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd2b4-cfcb-4696-8b75-a36a36e48a90 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:22.153965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:22.154593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:22.154873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:22.155146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:22.163180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:22.216014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 18:06:22.216510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250bc19-5755-46b2-ae7e-52598a8e1f40 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:22.226074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Sun Aug 7 18:06:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 18:06:22.232578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:22.246821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316bd65-eb5d-490a-b625-1e6cd228cd6e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:22.251834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:22.252958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:22.253244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:22.253516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] PATH_INFO: `/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:22.254956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab45c72f2c8847f1ab2e5e2de581c89e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:22.305479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING keystone.common.rbac_enforcer.enforcer [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 18:06:22.306017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c81cdf-c39b-4a75-9059-5a664c626459 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:22.310941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Aug 7 18:06:22 2022] GET /identity/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:24.308182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0cfd-9b5d-43dd-8fda-d27b1447a9ea None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:24.308742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0cfd-9b5d-43dd-8fda-d27b1447a9ea None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:24.308742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0cfd-9b5d-43dd-8fda-d27b1447a9ea None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:24.313377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:24.318646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:24.319034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:24.319191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:24.341344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:24.342866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:24.350642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 18:06:24.372020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0cfd-9b5d-43dd-8fda-d27b1447a9ea None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:24.384037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0cfd-9b5d-43dd-8fda-d27b1447a9ea None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:24.388761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc06ce-94b4-4a37-8072-87cb5ddaf76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:24.389350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc06ce-94b4-4a37-8072-87cb5ddaf76b admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:24.389630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc06ce-94b4-4a37-8072-87cb5ddaf76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:24.389903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc06ce-94b4-4a37-8072-87cb5ddaf76b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:24.397556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc06ce-94b4-4a37-8072-87cb5ddaf76b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:24.399322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc06ce-94b4-4a37-8072-87cb5ddaf76b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:24.409120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Sun Aug 7 18:06:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:06:24.414168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:24.422999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87376df-23ba-472b-a326-69ebf64c8710 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:24.427289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975acbf-24cd-475e-8660-19cfa57fb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:24.427900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975acbf-24cd-475e-8660-19cfa57fb496 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:24.428176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975acbf-24cd-475e-8660-19cfa57fb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:24.428446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975acbf-24cd-475e-8660-19cfa57fb496 admin admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:24.429783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975acbf-24cd-475e-8660-19cfa57fb496 admin admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:24.431574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975acbf-24cd-475e-8660-19cfa57fb496 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:24.433080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Sun Aug 7 18:06:24 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:26.469662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236ad1b-a615-40dc-b840-d081be62ddac None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.470213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236ad1b-a615-40dc-b840-d081be62ddac None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.470213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236ad1b-a615-40dc-b840-d081be62ddac None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.471539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:26.476740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.477159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.477287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.495442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:26.496641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:26.529339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbcc94-e8e2-4e6f-8c89-047c5d2e2302 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.529622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbcc94-e8e2-4e6f-8c89-047c5d2e2302 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.529900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbcc94-e8e2-4e6f-8c89-047c5d2e2302 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.531209 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:26.536331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.536640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.536913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.578173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:26.580084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG passlib.handlers.bcrypt [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80166) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 18:06:26.580506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG passlib.handlers.bcrypt [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80166) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 18:06:26.600104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:26.624009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:26.626296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:26.628086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:26.704912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7b42f-ee93-4352-97f8-ecdead0f248d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:26.725142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:26.738381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:26.739020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.739302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.739580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.747135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:26.750811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:26.759663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:26.760624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:26.761444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:26.767097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:26.849886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bc40a-5611-4f8d-ac3a-3ba9d6bdbe51 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:26.850637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:26.852303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:26.870060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74909e5d-8582-4d79-b16b-8e9fc7062f98 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:26.889067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:26.889923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.890206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.890480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.904753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:26.905350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:26.905626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:26.905892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:26.906547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:26.906843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:26.908216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:26.920142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:26.925673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:26.959903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:26.961459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:27.063371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:06:27.069353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:27.072518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:27.131498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb398f0-322e-47f0-971e-c3e71e607ce6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:27.165466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:27.166094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:27.166373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:27.166655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:27.167773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:27.169272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:27.170851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:26 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:27.172451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1bbde-9c13-4c09-98b7-9bbfca425c1d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:27.176403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:27.191054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:27.207618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:27.208466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:27.208774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:27.209047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:27.227173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:27.228665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:06:27.247407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:27.248390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:06:27.249373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:06:27.249373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:27.249373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:27.249373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:27.254358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:27.275846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2a7d-df78-4aa6-ba6d-8ddb2fac7cb5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:27.308988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:27.309767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:27.310064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:27.310345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:27.310951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:27.311471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:27.312959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:27.314573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:27.320346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:27.354335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16384183-a790-47c2-b953-c4ea7cc7952b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:27.388080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:27.388988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:27.389152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:27.389421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:27.390066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:27.390368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:27.391757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01572b84-0cae-455f-851b-b3d5c574c3c3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:27.400541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:27.410208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:27.420264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7305c-fede-4499-b58a-6af0599f5660 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:27.456765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:27.457400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:27.457683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:27.457960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:27.458708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.domain.id=default, user.id=7138c103c58f4e61a09c656d5711ef37) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:27.459020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:27.460556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67890cf1-58e7-4e7d-bcf5-101d3db73b5e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:27.469161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Sun Aug 7 18:06:27 2022] GET /identity/v3/role_assignments?user.id=7138c103c58f4e61a09c656d5711ef37&scope.domain.id=default&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:29.971737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790b63-7e3f-4499-a14e-5f9b12b6d1ae None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:29.972250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790b63-7e3f-4499-a14e-5f9b12b6d1ae None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:29.972346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790b63-7e3f-4499-a14e-5f9b12b6d1ae None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:29.973661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:29.990310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:29.990799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:29.990869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:29.996187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a798e8-c92e-4ad2-a18d-610002eafbcd None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:29.996479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a798e8-c92e-4ad2-a18d-610002eafbcd None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:29.997334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a798e8-c92e-4ad2-a18d-610002eafbcd None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:29.998662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:30.007502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24593c2-00be-4312-85d5-834f7d1b0498 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.007783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24593c2-00be-4312-85d5-834f7d1b0498 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.008058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24593c2-00be-4312-85d5-834f7d1b0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.021603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:30.022826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:30.037840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a24593c2-00be-4312-85d5-834f7d1b0498 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:30.039166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a24593c2-00be-4312-85d5-834f7d1b0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:30.160546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:30.164367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:30.198714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:30.202959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d268-93be-4f6b-b82d-acb76ae3bd67 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.203472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d268-93be-4f6b-b82d-acb76ae3bd67 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.203959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d268-93be-4f6b-b82d-acb76ae3bd67 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.206615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:30.207525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698d268-93be-4f6b-b82d-acb76ae3bd67 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:30.298210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:30.324480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:30.367732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698d268-93be-4f6b-b82d-acb76ae3bd67 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:30.389089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34cba-a4d7-4ade-a236-073133b64a63 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:30.422832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88fd57-44de-4fad-bd1a-3f8dfdf09bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:30.423372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88fd57-44de-4fad-bd1a-3f8dfdf09bea None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.423647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88fd57-44de-4fad-bd1a-3f8dfdf09bea None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.423917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88fd57-44de-4fad-bd1a-3f8dfdf09bea None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.428931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88fd57-44de-4fad-bd1a-3f8dfdf09bea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:30.430393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88fd57-44de-4fad-bd1a-3f8dfdf09bea None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:30.452512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:30.453571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.454091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.454561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.465894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:30.467666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6c04b9ef-8e0c-4bcc-98f3-58f9aa8c5ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:06:30.485892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:30.486805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:06:30.487599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:06:30.487599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:30.487599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:30.489566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 13/27] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:30.491254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c48c2-6195-4675-bfa5-6ed436c593b4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.491759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c48c2-6195-4675-bfa5-6ed436c593b4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.492294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c48c2-6195-4675-bfa5-6ed436c593b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.513674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ac7c48c2-6195-4675-bfa5-6ed436c593b4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:30.515239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ac7c48c2-6195-4675-bfa5-6ed436c593b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:30.607301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:30.607301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f988-54ca-4f1d-83d9-bd76fa91e838 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.607301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f988-54ca-4f1d-83d9-bd76fa91e838 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.607301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f988-54ca-4f1d-83d9-bd76fa91e838 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.607301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 15/29] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:30.607301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620f988-54ca-4f1d-83d9-bd76fa91e838 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:30.665938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:30.705988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 15/30] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Aug 7 18:06:30 2022] POST /identity/v3/roles => generated 219 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:30.707793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.708312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.708804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.714335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620f988-54ca-4f1d-83d9-bd76fa91e838 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:30.730096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:30.732095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:30.764781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:30.765694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.765975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.766249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.767509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:30.767822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:30.769639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:30.797486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:30.798383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:30.824452 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 16/32] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:30.829227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:30.884587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:30.947591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96f6b-6bf1-4bd1-add6-4d6b7d5a2358 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:30.960229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6127e0-ca1c-404d-bc92-a70d7748c68c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:30.973500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:31.002893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.003923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.004313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.004610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.007510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de9ca9-b90d-40ca-9abe-9e873957686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.008126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de9ca9-b90d-40ca-9abe-9e873957686b None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.008790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de9ca9-b90d-40ca-9abe-9e873957686b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.009094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de9ca9-b90d-40ca-9abe-9e873957686b None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.010029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de9ca9-b90d-40ca-9abe-9e873957686b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.011644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de9ca9-b90d-40ca-9abe-9e873957686b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.024039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:31.029928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:31.030798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:31.031542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:31.034803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 17/33] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:31.034803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.057164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:06:30 2022] POST /identity/v3/projects => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:31.058256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc1b4e-be0a-4efd-952c-3f87306b75e8 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.058543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc1b4e-be0a-4efd-952c-3f87306b75e8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.058815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc1b4e-be0a-4efd-952c-3f87306b75e8 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.060900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 18/35] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:31.061500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc1b4e-be0a-4efd-952c-3f87306b75e8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.187289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69dfc0-6242-404c-8d9b-20423133b46c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.198060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:31.216354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc1b4e-be0a-4efd-952c-3f87306b75e8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.247991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.248717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.249004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.249626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.250324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.251793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.261878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.263478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.263956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.264440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.265565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:31.266260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.267929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b8db-25b4-4084-b93a-1425d1e11bc6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.282641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 19/36] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:31.284180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8f244-acd7-4fb9-b3f2-9f06499924b1 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.284690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8f244-acd7-4fb9-b3f2-9f06499924b1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.285169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8f244-acd7-4fb9-b3f2-9f06499924b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.306750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-86e8f244-acd7-4fb9-b3f2-9f06499924b1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:31.306750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-86e8f244-acd7-4fb9-b3f2-9f06499924b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:31.388599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Aug 7 18:06:31 2022] POST /identity/v3/roles => generated 225 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:31.388827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:31.388926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.399594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605b211-ef00-4f8d-b340-0546747a8bb0 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.399879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605b211-ef00-4f8d-b340-0546747a8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.400422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605b211-ef00-4f8d-b340-0546747a8bb0 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.401932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 21/39] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:31.405488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605b211-ef00-4f8d-b340-0546747a8bb0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.435574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:31.498923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:31.513314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb1e9-ad2a-45fb-a104-6fc531757f4a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.523024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605b211-ef00-4f8d-b340-0546747a8bb0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.561039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b915081-a54e-4b84-93db-4527d14a6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.561695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915081-a54e-4b84-93db-4527d14a6aab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.561981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915081-a54e-4b84-93db-4527d14a6aab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.562263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915081-a54e-4b84-93db-4527d14a6aab None admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.563530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915081-a54e-4b84-93db-4527d14a6aab None admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.565147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915081-a54e-4b84-93db-4527d14a6aab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.565722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.566652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.566652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.566809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 19/40] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:31 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:31.568287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.568287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.568444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.568444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.568584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.569304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.587668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:31.589308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:31.594529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 22/41] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Aug 7 18:06:31 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:06:31.595463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.670845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:31.693361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.715774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a6dc-3ba6-4262-a5e3-d95ece9f2760 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.729503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:31.758344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.758907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.759185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.759457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.761032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.762127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.764620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 23/43] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:31.770019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.787195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:31.814901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48bede-b190-4a57-8354-c5e9b95aac9b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.849695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.850330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.850619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.850893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.851997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.853500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.855287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 21/44] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:31.860850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:31.885866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d6c92-dda5-423c-b1d6-ba9c825c2b7b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.920391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62296a62-1eb7-4dce-beba-6fb89b4c65ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:31.921091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296a62-1eb7-4dce-beba-6fb89b4c65ce None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:31.921372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296a62-1eb7-4dce-beba-6fb89b4c65ce None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:31.921653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296a62-1eb7-4dce-beba-6fb89b4c65ce None admin] PATH_INFO: `/v3/domains/default/users/7138c103c58f4e61a09c656d5711ef37/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:31.923957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62296a62-1eb7-4dce-beba-6fb89b4c65ce None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7138c103c58f4e61a09c656d5711ef37, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:31.925438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62296a62-1eb7-4dce-beba-6fb89b4c65ce None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:31.942277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 24/45] 10.222.0.25 () {58 vars in 1361 bytes} [Sun Aug 7 18:06:31 2022] PUT /identity/v3/domains/default/users/7138c103c58f4e61a09c656d5711ef37/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:06:31.962617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbfaa9-df0e-48ca-81d1-e212bab259d0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:31.964521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:32.002889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6629c43-7b19-4d86-9aff-446dfa8463a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:32.003513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6629c43-7b19-4d86-9aff-446dfa8463a1 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:32.004043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6629c43-7b19-4d86-9aff-446dfa8463a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:32.004043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6629c43-7b19-4d86-9aff-446dfa8463a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:32.004735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6629c43-7b19-4d86-9aff-446dfa8463a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:32.006226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6629c43-7b19-4d86-9aff-446dfa8463a1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:32.036614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:06:31 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:06:33.933083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78439a22-1c26-4f58-9f28-48c18187f860 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:33.933609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78439a22-1c26-4f58-9f28-48c18187f860 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:33.933609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78439a22-1c26-4f58-9f28-48c18187f860 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:33.935776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 25/47] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:33.941427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced901d5-42da-40f2-9dcd-a61764022f51 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:33.941919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced901d5-42da-40f2-9dcd-a61764022f51 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:33.942403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced901d5-42da-40f2-9dcd-a61764022f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:33.963999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ced901d5-42da-40f2-9dcd-a61764022f51 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:33.965236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ced901d5-42da-40f2-9dcd-a61764022f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:34.030815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:34.041964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2dc9-9fa3-4e81-9867-361b9caa8df4 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.042253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2dc9-9fa3-4e81-9867-361b9caa8df4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.042531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2dc9-9fa3-4e81-9867-361b9caa8df4 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.044610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 26/49] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:34.049368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.049659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.049939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.053818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2dc9-9fa3-4e81-9867-361b9caa8df4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.068197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:34.069416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:34.120971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:34.135150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 24/50] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:34.157023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2dc9-9fa3-4e81-9867-361b9caa8df4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.157394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.172234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:34.194583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.195208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.195486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.195760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.206788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:34.213360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:34.214329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:34.215071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 27/51] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:34.220451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.257994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f411-eb04-4e8d-a648-d5435b7dd74c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.290296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.290917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.291189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.291459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.292546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:34.294668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:34.296168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 25/52] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:34.301762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.321831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157375d-9221-494f-a001-0eb6358170f6 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.350209 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:34.359808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.360817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.361098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.361982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:34.362081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:34.363444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:34.371584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 28/53] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:34.377022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.383799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:34.404164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a4d0-4b02-42a6-a7e0-2c142a02617d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.438387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.438991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.439270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.439541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.440177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:34.441652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:34.468404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 26/54] 10.222.0.25 () {60 vars in 1140 bytes} [Sun Aug 7 18:06:34 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:06:34.477450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ab09-4bcf-45d5-a160-81be51c32f50 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.514565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.515225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.515500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.515770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.517009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:34.518487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:34.520151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 29/55] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:34 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:34.526180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.630330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a671-8586-4d22-9a5b-352a467ff01e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.664268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765a0ba-940c-420f-bab4-ad24bb3ff463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.664974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765a0ba-940c-420f-bab4-ad24bb3ff463 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.665265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765a0ba-940c-420f-bab4-ad24bb3ff463 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.665540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765a0ba-940c-420f-bab4-ad24bb3ff463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.666648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765a0ba-940c-420f-bab4-ad24bb3ff463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:34.668099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765a0ba-940c-420f-bab4-ad24bb3ff463 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:34.669702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 27/56] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:34.675629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:34.735743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:34.777870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dd004-299c-4585-98c3-067b5cfdfc65 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:34.812120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:34.812816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:34.813098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:34.813371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:34.814087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.domain.id=default, user.id=7138c103c58f4e61a09c656d5711ef37) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:34.814397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:34.815824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf28b-3432-48c7-8f21-3b2135066a36 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:34.823905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 30/57] 10.222.0.25 () {56 vars in 1322 bytes} [Sun Aug 7 18:06:34 2022] GET /identity/v3/role_assignments?user.id=7138c103c58f4e61a09c656d5711ef37&scope.domain.id=default&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:36.475567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191072-d228-4966-8a9b-d7950666f98f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:36.476079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191072-d228-4966-8a9b-d7950666f98f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:36.476159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191072-d228-4966-8a9b-d7950666f98f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:36.477495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:36.482925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:36.483306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:36.483472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:36.501614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:36.502786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:36.567142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:36.591240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191072-d228-4966-8a9b-d7950666f98f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:36.594200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:36.691702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191072-d228-4966-8a9b-d7950666f98f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:36.723704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe4d98-9f58-4891-90f0-ecde8bf03560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:36.724321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe4d98-9f58-4891-90f0-ecde8bf03560 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:36.724624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe4d98-9f58-4891-90f0-ecde8bf03560 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:36.724902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe4d98-9f58-4891-90f0-ecde8bf03560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:36.726043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe4d98-9f58-4891-90f0-ecde8bf03560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:36.727444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe4d98-9f58-4891-90f0-ecde8bf03560 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:36.729015 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 29/60] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:36.735198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:36.785758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:36.831235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed619bb-50ee-4820-8a6f-493a530599ab None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:36.864364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5344b-6493-4c45-b376-03e1e9db18d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:36.864986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5344b-6493-4c45-b376-03e1e9db18d8 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:36.865262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5344b-6493-4c45-b376-03e1e9db18d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:36.865529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5344b-6493-4c45-b376-03e1e9db18d8 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:36.866159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5344b-6493-4c45-b376-03e1e9db18d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:36.867600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5344b-6493-4c45-b376-03e1e9db18d8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:36.893441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 32/61] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:36 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:40.005961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116278e-5ffc-43e4-b541-b2e37823001c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.006917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116278e-5ffc-43e4-b541-b2e37823001c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.007487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116278e-5ffc-43e4-b541-b2e37823001c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.009073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 30/62] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:40.022231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4fde4-052d-457d-955a-a0aa27cdc01a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.023158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4fde4-052d-457d-955a-a0aa27cdc01a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.023634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4fde4-052d-457d-955a-a0aa27cdc01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.048412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-bdc4fde4-052d-457d-955a-a0aa27cdc01a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:40.049989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bdc4fde4-052d-457d-955a-a0aa27cdc01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:40.143186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 33/63] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:40.190099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116278e-5ffc-43e4-b541-b2e37823001c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.200800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e7ea-d7d7-4c69-8424-4f6259eb5f54 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.203089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e7ea-d7d7-4c69-8424-4f6259eb5f54 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.203592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e7ea-d7d7-4c69-8424-4f6259eb5f54 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.206485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 34/64] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:40.211812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da7cc-a4fe-4299-9313-c26073225e94 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.212348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da7cc-a4fe-4299-9313-c26073225e94 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.212849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da7cc-a4fe-4299-9313-c26073225e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.244973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-159da7cc-a4fe-4299-9313-c26073225e94 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:40.246199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-159da7cc-a4fe-4299-9313-c26073225e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:40.289030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:40.327939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 35/65] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:40.350495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:40.352543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e84f-2fba-40f2-ac14-73627242cec1 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.353938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e84f-2fba-40f2-ac14-73627242cec1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.354401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e84f-2fba-40f2-ac14-73627242cec1 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.356078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 36/66] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:40.361581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66225c-e7df-4f1a-a252-c35289dc14a1 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.362064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66225c-e7df-4f1a-a252-c35289dc14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.362648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66225c-e7df-4f1a-a252-c35289dc14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.385236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ce66225c-e7df-4f1a-a252-c35289dc14a1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:40.386427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ce66225c-e7df-4f1a-a252-c35289dc14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:40.395022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116278e-5ffc-43e4-b541-b2e37823001c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:40.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:40.434105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.434381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.434907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.445688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:40.450835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:40.451678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:40.452552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 31/67] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:40.453238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.467252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 37/68] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:40.469453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d333-fab4-4b72-be2b-25c0dde9ebcd None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.469886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d333-fab4-4b72-be2b-25c0dde9ebcd None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.470434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d333-fab4-4b72-be2b-25c0dde9ebcd None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.471994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 38/69] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:40.473050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d333-fab4-4b72-be2b-25c0dde9ebcd None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.562986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a4163-5e84-493a-8b00-bcc6186cb960 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:40.587997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:40.594157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:40.595329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d333-fab4-4b72-be2b-25c0dde9ebcd None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:40.600150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221977-c622-4036-88dd-4c137dadcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:40.600811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221977-c622-4036-88dd-4c137dadcc05 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.601092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221977-c622-4036-88dd-4c137dadcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.601404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221977-c622-4036-88dd-4c137dadcc05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.614124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98221977-c622-4036-88dd-4c137dadcc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-98221977-c622-4036-88dd-4c137dadcc05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:40.619102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:40.619898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:40.620720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:40.623658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 32/70] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:40.625033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.625310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.625577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.635756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:40.636362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.636665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.636986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.638319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:40.638627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:40.640026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:40.644162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:40.645582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:40.648797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 39/71] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:40.649752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.730154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 33/72] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:40.732466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.767729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4e88d-68c2-494c-ac12-d2161b71f2ea None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:40.806302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:40.806934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.807206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.807472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.818332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:40.823445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:40.824280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:40.825197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 40/73] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:40.826073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.844331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde744a-fbb4-4dd2-aeb5-7d25bbff8608 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:40.847111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:40.864598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:40.879564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:40.880177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.880455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.880758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.881415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:40.881713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:40.883102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:40.891328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 34/74] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:40.892209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.927936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff2aa0-803a-40d7-a20a-7e5101105e05 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:40.960711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe95b8-d1aa-44d0-9d82-52498c83b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:40.961335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe95b8-d1aa-44d0-9d82-52498c83b060 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.961617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe95b8-d1aa-44d0-9d82-52498c83b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.961877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe95b8-d1aa-44d0-9d82-52498c83b060 None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.976394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe95b8-d1aa-44d0-9d82-52498c83b060 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:40.977889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe95b8-d1aa-44d0-9d82-52498c83b060 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:40.979489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 41/75] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:40.981162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74d8e-3903-4252-baa1-4ee78568de23 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:40.981447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74d8e-3903-4252-baa1-4ee78568de23 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:40.981719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74d8e-3903-4252-baa1-4ee78568de23 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:40.982918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 42/76] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:40.983609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74d8e-3903-4252-baa1-4ee78568de23 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:40.992264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c425a0-81e9-4a8d-ba27-fc689066b716 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.026034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.026661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.026931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.027201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.037088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:41.042164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:41.043008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:41.044425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 35/77] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:41.045402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.068881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.088168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.091626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74d8e-3903-4252-baa1-4ee78568de23 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.124819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.125349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.125624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.125893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.126548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:41.126856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.128228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.136025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 43/78] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:06:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.136825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.149630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d526-bcd3-49be-9c8b-9cc0d9c914ab None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.183354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace335f3-12a0-4d19-8fc4-6e70fa9cbbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.184026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace335f3-12a0-4d19-8fc4-6e70fa9cbbba None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.184306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace335f3-12a0-4d19-8fc4-6e70fa9cbbba None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.184604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace335f3-12a0-4d19-8fc4-6e70fa9cbbba None admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.185749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace335f3-12a0-4d19-8fc4-6e70fa9cbbba None admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.187201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace335f3-12a0-4d19-8fc4-6e70fa9cbbba None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.188810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 36/79] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.189995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.190281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.190569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.207687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:41.208929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:41.238286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979161f-64d5-4c34-bb66-1836b9ac6371 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.271619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.272224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.272504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.272808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.273801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:41.277974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.284419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.320897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.343416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.344921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.378490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3a91d-3515-4914-9ca3-9074741599df None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.412953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.413553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.413828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.414094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.414744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:41.415043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.416398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.424720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 38/81] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.425495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.443408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 44/82] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:41.444124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.486357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.524831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4aea-4858-4969-91ae-133987b3946f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.526670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.543792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b198e-4b08-479c-8538-2eb855f5f358 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.559133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.559759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.560041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.560312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.561488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.562938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.564519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.565299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.581913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.582522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.582800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.583075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.648586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.650260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.664684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686aaf1-6df5-40de-a642-ddb29a07948d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.689543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.698323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.698951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.699233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.700048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.701284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.702757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.709020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 40/84] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.709020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.745715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.754953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 45/85] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:41.755800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.815221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ff82e-e4b0-46e0-833a-ded74e6b34a4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.849145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.849776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.850060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.850340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.851459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.852953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.854542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 41/86] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.855300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.858732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379caaef-b0fd-4935-a245-f6a202e93d69 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.894017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.894639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.894914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.895183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.896280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.897758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.899424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 46/87] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.900365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.910945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.953936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754e10-eec3-4a14-96e8-2c702ca65bc4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.960652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:41.987961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.988654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.988934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.989203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.999878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cad97-1ef5-43a8-872a-f35ef7e834ae None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.034920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.035528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.035810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.036094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.036778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.038228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.071717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 47/88] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:41 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:42.072365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.072738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.072824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.133511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:42.176833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c86d74-70d2-4170-815d-29b7c30ee9ab None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.184781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 42/89] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:42.189016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.198812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:42.221764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.222740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.222740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.223074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.224205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.225849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.227841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 48/90] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:42.228964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.311369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e483b3-038a-4afb-b707-880c168d7355 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.355723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.356350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.356652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.356926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.358497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2baf-b2e1-43c1-859f-f9cec175a464 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.394962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:42.401637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.402512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.403439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.404008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.404918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=cb7ed9b5bb6b47519b15cad121f36d73) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:42.405702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.407539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.413703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 49/91] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/role_assignments?user.id=cb7ed9b5bb6b47519b15cad121f36d73&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:42.414502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.440044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.442054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.451694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:42.552673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de1be6-d9e7-4c0a-b418-6e2e8b76bd56 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.599226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 43/92] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:42.606331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.636437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.637145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.637434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.637719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.639059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.642366 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.642910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 50/93] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:42.643710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.745629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2b65a-1a95-4290-aea1-caff70d1b689 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.754840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:42.787360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.787851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:42.787961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.788247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.788603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.792032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=7138c103c58f4e61a09c656d5711ef37) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:42.792360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.794221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.800691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 44/94] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/role_assignments?user.id=7138c103c58f4e61a09c656d5711ef37&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:42.801343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:42.921220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0286-458e-4c2e-b80a-7cfd8de09717 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.954672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3fc0-5b2a-4196-9356-f9949897526e None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:42.961481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:42.962108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:42.962393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:42.962671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:42.963402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] RBAC: Adding query filter params (role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=cb7ed9b5bb6b47519b15cad121f36d73) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:42.963712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:42.965273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:42.971627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 45/95] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/role_assignments?user.id=cb7ed9b5bb6b47519b15cad121f36d73&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:43.016621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed3685-b5dc-4147-875c-5da5a45c367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.017192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed3685-b5dc-4147-875c-5da5a45c367f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.017470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed3685-b5dc-4147-875c-5da5a45c367f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.017740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed3685-b5dc-4147-875c-5da5a45c367f None admin] PATH_INFO: `/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.021393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed3685-b5dc-4147-875c-5da5a45c367f None admin] RBAC: Authorizing `identity:get_project(project_id=de74ff877c6f4fbaa43f9e3eb97db92f)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:43.022884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed3685-b5dc-4147-875c-5da5a45c367f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:43.024787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 51/96] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:42 2022] GET /identity/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f => generated 312 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:43.031465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.100979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:43.191927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7e2f6-dbc9-4070-b1b2-f64935fba463 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.240014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.240672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.240960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.241234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.241969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=de74ff877c6f4fbaa43f9e3eb97db92f, user.id=cb7ed9b5bb6b47519b15cad121f36d73) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:43.242280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:43.243723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7693f-ae85-482c-bfce-f1b0a7f6fb56 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:43.250997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 46/97] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/role_assignments?user.id=cb7ed9b5bb6b47519b15cad121f36d73&scope.project.id=de74ff877c6f4fbaa43f9e3eb97db92f&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:44.809836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f936bc-5264-4b98-aec4-e5305c20248b None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:44.810664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f936bc-5264-4b98-aec4-e5305c20248b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:44.811104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f936bc-5264-4b98-aec4-e5305c20248b None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:44.812851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 52/98] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:44.818199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:44.818928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:44.819338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:44.842003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:44.843235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:44.924752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 47/99] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:44.956489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f936bc-5264-4b98-aec4-e5305c20248b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:45.120547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f936bc-5264-4b98-aec4-e5305c20248b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:45.162747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:45.169277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198836-b820-40a8-8db2-c30c9e7c5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:45.170561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198836-b820-40a8-8db2-c30c9e7c5080 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.170860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198836-b820-40a8-8db2-c30c9e7c5080 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.171145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198836-b820-40a8-8db2-c30c9e7c5080 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.193829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198836-b820-40a8-8db2-c30c9e7c5080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b2198836-b820-40a8-8db2-c30c9e7c5080 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:45.198645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:45.200496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:45.201770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 53/100] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:45.208964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:45.255748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:45.348399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5782e-c4e2-40d2-a9dc-efa20182f6c2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.348767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5782e-c4e2-40d2-a9dc-efa20182f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.349063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5782e-c4e2-40d2-a9dc-efa20182f6c2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.351963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 54/101] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:45.362311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.362610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.362850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.371082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f118f98-7b77-4d2a-9fc1-bd288f905cd8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:45.404458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:45.405703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:45.469849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:45.470468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.470744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.471023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.471661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:45.471962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:45.473361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:45.498375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 48/102] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:45.505098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:45.585758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 55/103] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:45.631762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:45.707107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:45.725583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1a00-ad68-41b1-9eb4-afcad510fada None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:45.787315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96e8e-fa93-4f63-8c63-fea1813ed816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:45.788076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96e8e-fa93-4f63-8c63-fea1813ed816 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.788354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96e8e-fa93-4f63-8c63-fea1813ed816 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.788666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96e8e-fa93-4f63-8c63-fea1813ed816 None admin] PATH_INFO: `/v3/users/64fb03e8318f4699a68844383e7a5025` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.816017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b96e8e-fa93-4f63-8c63-fea1813ed816 None admin] RBAC: Authorizing `identity:get_user(user_id=64fb03e8318f4699a68844383e7a5025)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:45.818349 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b96e8e-fa93-4f63-8c63-fea1813ed816 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:45.820343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 49/104] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:45 2022] GET /identity/v3/users/64fb03e8318f4699a68844383e7a5025 => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:45.825654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17e1f-7cf6-4753-86a3-df0394fff08a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.826231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17e1f-7cf6-4753-86a3-df0394fff08a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.826701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17e1f-7cf6-4753-86a3-df0394fff08a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.828315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 50/105] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:45.831322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2461-4ae6-4a62-beb3-93818fc1a854 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.834324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152da04-f2b3-4754-9b0b-c6ac90934e8e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:45.836660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2461-4ae6-4a62-beb3-93818fc1a854 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.836941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2461-4ae6-4a62-beb3-93818fc1a854 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.838501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 51/106] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:45.839879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2461-4ae6-4a62-beb3-93818fc1a854 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:45.870842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:45.888152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e58af6-6049-4706-9a41-da14e6cdfbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:45.889680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e58af6-6049-4706-9a41-da14e6cdfbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.890479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e58af6-6049-4706-9a41-da14e6cdfbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.891317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e58af6-6049-4706-9a41-da14e6cdfbe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.908289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e58af6-6049-4706-9a41-da14e6cdfbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-16e58af6-6049-4706-9a41-da14e6cdfbe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:45.915834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:45.917568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:45.919149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:45.927507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 56/107] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:45.927507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117c0f-cebb-4bd4-86cf-6f08f583a195 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:45.927507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117c0f-cebb-4bd4-86cf-6f08f583a195 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:45.927507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117c0f-cebb-4bd4-86cf-6f08f583a195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:45.948655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8f117c0f-cebb-4bd4-86cf-6f08f583a195 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:45.951145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8f117c0f-cebb-4bd4-86cf-6f08f583a195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:45.975001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2461-4ae6-4a62-beb3-93818fc1a854 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.020506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.021653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.021998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.022280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.051039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.059483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 57/108] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:46.059483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.059483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.059483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.091945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:46.093606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:46.142057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.144088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.180584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 58/109] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:46.180584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.230816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.271343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 52/110] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:46.271343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.293989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca168c0-0699-4522-a548-e533ae3fc67f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.320887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.331448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.332058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.332338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.332643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.333311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:46.333616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.335012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbf6af-200f-45f7-9b99-ecf655a01d97 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.343389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 59/111] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:46.345843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddae3c3-f09e-4bfc-8aac-bf23c9bea8fb None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.346132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddae3c3-f09e-4bfc-8aac-bf23c9bea8fb None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.346420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddae3c3-f09e-4bfc-8aac-bf23c9bea8fb None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.347882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 60/112] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:46.348359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddae3c3-f09e-4bfc-8aac-bf23c9bea8fb None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.373220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf526-c922-4f08-a721-8b3d8dc52f85 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.406852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.407409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.407688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.407966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.409115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.410776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.412354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 53/113] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:46.417095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.449570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddae3c3-f09e-4bfc-8aac-bf23c9bea8fb None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.451814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.485600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e61cdf-f8e0-4f46-a8e8-199ead86daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.486579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61cdf-f8e0-4f46-a8e8-199ead86daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.486855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61cdf-f8e0-4f46-a8e8-199ead86daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.487183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61cdf-f8e0-4f46-a8e8-199ead86daf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.497776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e61cdf-f8e0-4f46-a8e8-199ead86daf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e3e61cdf-f8e0-4f46-a8e8-199ead86daf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:46.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:46.503402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:46.504263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 61/114] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:46.505278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42214725-6d5c-4bd8-b93b-a3d9dda8eeb0 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.505278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42214725-6d5c-4bd8-b93b-a3d9dda8eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.505278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42214725-6d5c-4bd8-b93b-a3d9dda8eeb0 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.506293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 62/115] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:46.506982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42214725-6d5c-4bd8-b93b-a3d9dda8eeb0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.524217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06dfcf-e810-4c3a-b22d-85ed3d3edc14 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.541230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.559616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd42ed-a79c-4003-bac7-837180467d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.560249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd42ed-a79c-4003-bac7-837180467d10 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.560527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd42ed-a79c-4003-bac7-837180467d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.560828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd42ed-a79c-4003-bac7-837180467d10 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.561934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd42ed-a79c-4003-bac7-837180467d10 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.563374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd42ed-a79c-4003-bac7-837180467d10 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.565109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 54/116] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:46.566292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.566576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.566849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.584333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:46.585535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:46.614576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42214725-6d5c-4bd8-b93b-a3d9dda8eeb0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.647847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb7fe1-6a6d-41e6-a60a-f413edcc54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.648465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb7fe1-6a6d-41e6-a60a-f413edcc54bc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.648767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb7fe1-6a6d-41e6-a60a-f413edcc54bc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.649037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb7fe1-6a6d-41e6-a60a-f413edcc54bc None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.650389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb7fe1-6a6d-41e6-a60a-f413edcc54bc None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.650688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 55/117] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:46.651507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.652133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb7fe1-6a6d-41e6-a60a-f413edcc54bc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.654323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 63/118] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:46.656003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.656003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.656003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.683428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:46.684679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:46.710838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.750711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 64/119] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:46.751812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.764147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9c459-63b8-4135-9598-02d4421b3115 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.779217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.801400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.802013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.802288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.802556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.803193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.804668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.830621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 56/120] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:06:46 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:46.831521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.867097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df75c9c-34ae-4821-b887-24feb455d319 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.910420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.911373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.911373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.911571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.912233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:46.912597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:46.913987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:46.928854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 65/121] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:46.928854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.955581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.956770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe29a-47e9-44cc-8a9a-6085bf5d5005 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.997661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.997661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.998087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.998245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.998975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] RBAC: Adding query filter params (role.id=cfc7a3168b4e41e5bf325e24e770bedc, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=64fb03e8318f4699a68844383e7a5025) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:46.999800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.000901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.008935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 57/122] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/role_assignments?user.id=64fb03e8318f4699a68844383e7a5025&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=cfc7a3168b4e41e5bf325e24e770bedc => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.009951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.053231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.063429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4b4a4-54ec-4361-8acc-aefbe788790c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.115630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.116399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.116779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.117164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.118474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.120205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.122117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 66/123] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.122923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.145088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e4fa6-a5c2-404d-a10f-aab63e6ebb38 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.197842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.198477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.198760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.199026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.212436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:47.218578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:47.219450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:47.220211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 58/124] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:47.221414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.249454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.264032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21fee-e9c7-4f5c-8cd3-35e43bef9203 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.308466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.309718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.310091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.310366 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.321495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:47.327336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:47.328244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:47.329054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 67/125] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:47.329698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.330204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.347026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5281e-3bf1-4278-9bd5-9bf61652af71 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.396585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.397461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.397950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.398933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.400766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.403581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.406343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 59/126] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.407550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.460954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb3d5-b06c-4bcb-80d7-7e13401a15a9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.511251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.513128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.513406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.513677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/cb7ed9b5bb6b47519b15cad121f36d73/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.516319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=90c5d2195aa940ddbaac1ea6fab6bf97, user_id=cb7ed9b5bb6b47519b15cad121f36d73, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.517812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.526303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bbe1-363f-4672-8470-72653382e6a5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.535474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 68/127] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:06:47 2022] PUT /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/cb7ed9b5bb6b47519b15cad121f36d73/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:06:47.536919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.559992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.570190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.572979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.573553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.574095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.576888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:47.577484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.579217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.589072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 60/128] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.590628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.617105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.664201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f14e-0e6e-4e2d-87e8-f3b64d496ca1 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.700919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.701542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.701817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.702094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.703187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:47.703187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.704472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.717989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 69/129] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.718835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.719720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa3f52-ee5f-4379-98a3-647e1c6893fb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.780014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.781120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.781673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.782168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.783678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.789672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.791744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 61/130] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.793661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.805033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.827523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a736a07-f677-4196-88c3-581c4861ebc3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.875272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.876021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.876208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.876794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.880968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.883696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.886734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 70/131] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.888002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.960620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.979657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9f022-1c65-4fe5-b834-c705c28d91c9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.013160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016781-0382-4163-9721-556c2c5e85a3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.034355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.034872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.035152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.035422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.041291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.042753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.045082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 62/132] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:48.045966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.055279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.056247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.056769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.057269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/7138c103c58f4e61a09c656d5711ef37/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.060204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] RBAC: Authorizing `identity:create_grant(project_id=90c5d2195aa940ddbaac1ea6fab6bf97, user_id=7138c103c58f4e61a09c656d5711ef37, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.061910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.079804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 71/133] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:06:47 2022] PUT /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/7138c103c58f4e61a09c656d5711ef37/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:06:48.081163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.084201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.208206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debc9d6-9916-4a4b-99f0-0cd0636abc59 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.248289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.249422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.249906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.250458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] PATH_INFO: `/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.251937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] RBAC: Authorizing `identity:get_project(project_id=de74ff877c6f4fbaa43f9e3eb97db92f)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.253849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.255883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 72/134] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:48 2022] GET /identity/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:48.263079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.279397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f248662-8f65-4efd-b750-87cf282734e9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.357483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.358481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.360121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.360665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.365024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.366821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.371450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 63/135] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:48 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:48.378089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.417333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.430032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.483525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3123-a137-4413-9b46-2b5d9f99adc7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.521822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795615-aa34-4958-acca-5413713e493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.522641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795615-aa34-4958-acca-5413713e493a None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.523028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795615-aa34-4958-acca-5413713e493a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.523413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795615-aa34-4958-acca-5413713e493a None admin] PATH_INFO: `/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f/users/cb7ed9b5bb6b47519b15cad121f36d73/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.525759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d795615-aa34-4958-acca-5413713e493a None admin] RBAC: Authorizing `identity:create_grant(project_id=de74ff877c6f4fbaa43f9e3eb97db92f, user_id=cb7ed9b5bb6b47519b15cad121f36d73, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.527492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d795615-aa34-4958-acca-5413713e493a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.542436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 73/136] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:06:48 2022] PUT /identity/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f/users/cb7ed9b5bb6b47519b15cad121f36d73/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:06:48.589573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28289eb7-7f1a-454e-866a-9004040d3e98 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.649397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d3d2-b094-42e8-90dd-f58c44a6a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.650269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d3d2-b094-42e8-90dd-f58c44a6a92b None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.650569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d3d2-b094-42e8-90dd-f58c44a6a92b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.650849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d3d2-b094-42e8-90dd-f58c44a6a92b None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/cb7ed9b5bb6b47519b15cad121f36d73/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.653905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8d3d2-b094-42e8-90dd-f58c44a6a92b None admin] RBAC: Authorizing `identity:create_grant(project_id=90c5d2195aa940ddbaac1ea6fab6bf97, user_id=cb7ed9b5bb6b47519b15cad121f36d73, role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.655430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8d3d2-b094-42e8-90dd-f58c44a6a92b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.679093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 64/137] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:06:48 2022] PUT /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/cb7ed9b5bb6b47519b15cad121f36d73/roles/709c5429fa39482fa0cd40f9104ce17d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:06:49.299802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71efd8-ffdf-4f37-bde2-b969081603d3 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:49.300327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71efd8-ffdf-4f37-bde2-b969081603d3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:49.300729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71efd8-ffdf-4f37-bde2-b969081603d3 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:49.302092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 74/138] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:49.307496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb642-de77-46e2-b330-55463c9d2056 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:49.308028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb642-de77-46e2-b330-55463c9d2056 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:49.308195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb642-de77-46e2-b330-55463c9d2056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:49.336717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-de9eb642-de77-46e2-b330-55463c9d2056 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:49.337938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-de9eb642-de77-46e2-b330-55463c9d2056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:49.438693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 65/139] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:49.498538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71efd8-ffdf-4f37-bde2-b969081603d3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:49.612785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71efd8-ffdf-4f37-bde2-b969081603d3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:49.636368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fec7c-9794-4666-b77d-19742025a61c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:49.636740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fec7c-9794-4666-b77d-19742025a61c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:49.637201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fec7c-9794-4666-b77d-19742025a61c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:49.638773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 66/140] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:49.643794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:49.644079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:49.644355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:49.662012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:49.673934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:49.675465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:49.676374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:49.676701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:49.677015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:49.678184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:49.679026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:49.682147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:49.686155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 75/141] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:49.694407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:49.704927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:49.842001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 67/142] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 07 18:06:49.876855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:49.926271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440194-684c-4d74-8088-a7412d833cd4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:49.989996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:49.990623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:49.990904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:49.991428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:49.992081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:49.993545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:50.040009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 76/143] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:49 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:50.080019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad8f0-83d1-4750-ba21-5876579bb079 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.132190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f52a2-2067-4270-a77f-ba9f6a798a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.132802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f52a2-2067-4270-a77f-ba9f6a798a9c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.133077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f52a2-2067-4270-a77f-ba9f6a798a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.133348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f52a2-2067-4270-a77f-ba9f6a798a9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.150417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f52a2-2067-4270-a77f-ba9f6a798a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-509f52a2-2067-4270-a77f-ba9f6a798a9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:50.155797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:50.156664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:50.157563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 68/144] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:50.164661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.230248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.298613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa509b-3a47-47b2-9958-74caca339473 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.340333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.341108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.341324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.341651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.342364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:50.342661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:50.344249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:50.352060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77eb27-ec50-4cf8-b46c-c94f91cd3287 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.352626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77eb27-ec50-4cf8-b46c-c94f91cd3287 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.352788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77eb27-ec50-4cf8-b46c-c94f91cd3287 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.354151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 69/145] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:50.359810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 77/146] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:50.364576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.364787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.365012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.370126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.375041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.397849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:50.398975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:50.507954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4889b9-2c3e-4f7c-96f0-edba4a8f663d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.535634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.541136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 70/147] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:50.564035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.564751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.565029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.565300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] PATH_INFO: `/v3/users/64fb03e8318f4699a68844383e7a5025` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.566540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] RBAC: Authorizing `identity:get_user(user_id=64fb03e8318f4699a68844383e7a5025)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:50.568028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:50.570769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 78/148] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/users/64fb03e8318f4699a68844383e7a5025 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:50.575830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.620190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.712286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f78b-d071-42a9-93ce-d75c498f2b76 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.770194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.770842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.771122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.771395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.773580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f1d4-0600-4b7f-92f5-b1aa2ff54266 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.777304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:50.778862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:50.780859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 71/149] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:50.786522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.802126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.819633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.820376 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.820689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.820966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.832584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:50.838263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:50.841374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:50.843341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 79/150] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:50.849811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.910350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.924610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cae1a-4509-4431-a289-36a9517f810f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.974280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.974886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.975165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.975435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/64fb03e8318f4699a68844383e7a5025/roles/cfc7a3168b4e41e5bf325e24e770bedc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.982117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=90c5d2195aa940ddbaac1ea6fab6bf97, user_id=64fb03e8318f4699a68844383e7a5025, role_id=cfc7a3168b4e41e5bf325e24e770bedc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:50.983272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d8a6-74ad-4bd2-9848-fd664e0b7c27 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.983571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.007249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 72/151] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:06:50 2022] PUT /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/users/64fb03e8318f4699a68844383e7a5025/roles/cfc7a3168b4e41e5bf325e24e770bedc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:06:51.028516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.029191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.029472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.029743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.030474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:51.030777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.032249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.042398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 80/152] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:51.049204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.133887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.189284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81661-04cc-4efe-bceb-e5ffe7d035f9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.226810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d022af-5dc8-4078-b323-fd18be73fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.227368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d022af-5dc8-4078-b323-fd18be73fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.227644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d022af-5dc8-4078-b323-fd18be73fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.227916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d022af-5dc8-4078-b323-fd18be73fcf3 None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.231001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d022af-5dc8-4078-b323-fd18be73fcf3 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.232602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d022af-5dc8-4078-b323-fd18be73fcf3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.234586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 73/153] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:51 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:51.240220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.378040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496bd83-98a6-490c-a838-15593925b6cc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.390524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.427625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.428655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.429151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.429632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.512229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.514301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.539288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41afa9-10dc-408f-b111-47e1457acca6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.539806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41afa9-10dc-408f-b111-47e1457acca6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.539806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41afa9-10dc-408f-b111-47e1457acca6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.541492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 74/154] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:51.547183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.547463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.547736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.583344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:51.584585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:51.648673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 81/155] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:51.656134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.665080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.746745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 75/156] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:51.802841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.805195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882b4d0-4357-47de-89d4-0ed345dd46a6 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.888120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8eb-515e-4aa0-8bae-b4b53eda0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.889302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8eb-515e-4aa0-8bae-b4b53eda0170 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.889779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8eb-515e-4aa0-8bae-b4b53eda0170 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.890261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8eb-515e-4aa0-8bae-b4b53eda0170 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.897030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848a8eb-515e-4aa0-8bae-b4b53eda0170 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.899705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848a8eb-515e-4aa0-8bae-b4b53eda0170 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.905677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 82/157] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:51 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:51.908297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea1697-d7c9-47c7-bae3-0fa1cb0d2b84 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.910844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea1697-d7c9-47c7-bae3-0fa1cb0d2b84 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.911324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea1697-d7c9-47c7-bae3-0fa1cb0d2b84 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.915733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 83/158] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:51.921737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.922450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.922984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.932942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.952494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:51.954090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:52.036975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3f21-b68f-4261-b549-6b0ae3175e5f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.058323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 84/159] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:52.059214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:52.062586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:52.120853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.121556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.121836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.122105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.154210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:52.159030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:52.159965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:52.160782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 76/160] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:52.161452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:52.193169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeff35e-0694-4d45-8824-37468340fd60 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.241282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.241888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.242160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.242430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.243153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=cb7ed9b5bb6b47519b15cad121f36d73) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:52.243454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:52.244910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:52.251660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 85/161] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:52 2022] GET /identity/v3/role_assignments?user.id=cb7ed9b5bb6b47519b15cad121f36d73&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:52.252522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:52.361052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:52.368502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df39d-9b2d-4be0-93a3-1c5a0553ffd3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.418635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f47d7-e35c-4526-8316-7ac4c94dcc4c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.427475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:52.465915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.466574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.466856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.467128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.482387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.483004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.483281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.483644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.484318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:52.484646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:52.486101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:52.505600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:52.507890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 86/162] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:52.510526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:52.511370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:52.512285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 77/163] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:52.517816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:52.529534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:52.671707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dd213-9004-4b84-819b-36e52625ac3b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.695820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48e637-2ceb-4cdc-9976-3d4d27de9036 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.712917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:52.724659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda248e1-b23c-4b9d-9607-0a2f667c589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.725305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda248e1-b23c-4b9d-9607-0a2f667c589b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.725583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda248e1-b23c-4b9d-9607-0a2f667c589b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.725855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda248e1-b23c-4b9d-9607-0a2f667c589b None admin] PATH_INFO: `/v3/users/7138c103c58f4e61a09c656d5711ef37` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.733630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda248e1-b23c-4b9d-9607-0a2f667c589b None admin] RBAC: Authorizing `identity:get_user(user_id=7138c103c58f4e61a09c656d5711ef37)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:52.735145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda248e1-b23c-4b9d-9607-0a2f667c589b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:52.737089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 87/164] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:52 2022] GET /identity/v3/users/7138c103c58f4e61a09c656d5711ef37 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:52.744006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634c30a-3f96-44ed-baa3-3f45d613f706 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.744255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634c30a-3f96-44ed-baa3-3f45d613f706 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.744544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634c30a-3f96-44ed-baa3-3f45d613f706 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.747266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 88/165] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:52.753983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634c30a-3f96-44ed-baa3-3f45d613f706 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:52.775504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.776087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.776359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.776649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.777348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:52.777640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:52.779123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dddaf-45ef-433f-ad63-6e3aa897d2ba None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:52.803740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 78/166] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:52.809084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.809084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.809084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:52.846714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:52.847904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:52.929472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634c30a-3f96-44ed-baa3-3f45d613f706 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:52.967070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:52.980833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:52.981442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:52.981717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:52.981986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.034178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 79/167] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:53.034855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.087340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.092913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:53.113694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:53.243272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 89/168] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:53.244229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.286876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea360-471f-4063-b4d1-2b6e56426937 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.370284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:53.373700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc0a5a-240b-42dc-aa95-490c5d342fab None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.386388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.387606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.387875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.388144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.389288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.390745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:53.392316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 80/169] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:53.401662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.447863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.448513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.448782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.449106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.470418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:53.475262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:53.476165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:53.476992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 90/170] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:53.484962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.485646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:53.603237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca268690-3e9d-4c56-8cd4-2212cbd0a025 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.669443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.670377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.671364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.671817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.673353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.675371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:53.681685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 81/171] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:53.682767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.718834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43e521-64ba-41f7-ae94-47b8326138ce None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.829281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3383a-0580-4db7-93bb-ca5236129870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.829956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3383a-0580-4db7-93bb-ca5236129870 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.830235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3383a-0580-4db7-93bb-ca5236129870 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.830512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3383a-0580-4db7-93bb-ca5236129870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.836403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311549f2-e411-4abb-b235-a7a1a51d53fd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.872984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:53.877134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.878169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.878636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.879151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.880191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:53.880702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.882268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:53.891808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 82/172] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:53.893200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.894924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:53.942900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3383a-0580-4db7-93bb-ca5236129870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.944371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3383a-0580-4db7-93bb-ca5236129870 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.051121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 91/173] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:54.052380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaffe-5021-43b1-9735-9eccd5854357 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.052688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaffe-5021-43b1-9735-9eccd5854357 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.052959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaffe-5021-43b1-9735-9eccd5854357 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.054198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 92/174] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:54.054888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaffe-5021-43b1-9735-9eccd5854357 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.100027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca13e5-ad4a-4e5f-b64e-8ffdef3f0e2b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.137008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:54.172277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.172921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.173200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.173473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.174203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=7138c103c58f4e61a09c656d5711ef37) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:54.174510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:54.175963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7923af-2435-4be3-8e00-b001cf087fac None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.179830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaffe-5021-43b1-9735-9eccd5854357 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.191394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 83/175] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/role_assignments?user.id=7138c103c58f4e61a09c656d5711ef37&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:54.192659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.192944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.193217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.232303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:54.233556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:54.252528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.253268 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.253544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.253815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] PATH_INFO: `/v3/users/cb7ed9b5bb6b47519b15cad121f36d73` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.257324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] RBAC: Authorizing `identity:get_user(user_id=cb7ed9b5bb6b47519b15cad121f36d73)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:54.260031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.264256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 93/176] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/users/cb7ed9b5bb6b47519b15cad121f36d73 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:54.265444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.288928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:54.367950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 84/177] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:54.370026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.483514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b7c0-69db-4025-b615-ee650780e2cd None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.493040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03d86-ad95-4369-9b6b-95265a8208f6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.544144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:54.559585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.561233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.562215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.562780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] PATH_INFO: `/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.564825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=de74ff877c6f4fbaa43f9e3eb97db92f)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:54.566886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.570171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 94/178] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/projects/de74ff877c6f4fbaa43f9e3eb97db92f => generated 312 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:54.571624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.572383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.573181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.573613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.574551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.631076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:54.699438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:54.700930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.740969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25a5af-6091-4316-b796-f3efbd5eb4f6 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.790366 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc38d0-8cda-4703-9bcb-43835096b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.791327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc38d0-8cda-4703-9bcb-43835096b9db None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.791777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc38d0-8cda-4703-9bcb-43835096b9db None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.792213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc38d0-8cda-4703-9bcb-43835096b9db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.814010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc38d0-8cda-4703-9bcb-43835096b9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:54.814485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 85/179] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:54.815333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-26cc38d0-8cda-4703-9bcb-43835096b9db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:54.820547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:54.821681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 95/180] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:54.822439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea304-8c7e-431d-bd50-34cd87f65126 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.823138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea304-8c7e-431d-bd50-34cd87f65126 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.823138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea304-8c7e-431d-bd50-34cd87f65126 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.823862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 96/181] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:54.825852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610a32c-8859-4258-ac3a-794f1a679e91 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.828879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610a32c-8859-4258-ac3a-794f1a679e91 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.829383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610a32c-8859-4258-ac3a-794f1a679e91 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.831576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 97/182] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:54.833539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610a32c-8859-4258-ac3a-794f1a679e91 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.895805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:54.908042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:54.949610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610a32c-8859-4258-ac3a-794f1a679e91 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.950233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0153c4-5cff-4c2c-b8bb-0aa6de43dfe3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:54.983682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.984070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:54.984278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.984553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.984729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:54.984847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.984988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:54.985258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:54.985555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=de74ff877c6f4fbaa43f9e3eb97db92f, user.id=cb7ed9b5bb6b47519b15cad121f36d73) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:54.985859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:54.986354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:54.987298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4af0-a95b-4cbb-880b-11d0aa660884 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.987791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:54.989452 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 98/183] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:54.990205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:54.996363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 86/184] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/role_assignments?user.id=cb7ed9b5bb6b47519b15cad121f36d73&scope.project.id=de74ff877c6f4fbaa43f9e3eb97db92f&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:55.000972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622d487-73ea-48b5-ae1f-322de37938a7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.001242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622d487-73ea-48b5-ae1f-322de37938a7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.001513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622d487-73ea-48b5-ae1f-322de37938a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.023389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d622d487-73ea-48b5-ae1f-322de37938a7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:55.024657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d622d487-73ea-48b5-ae1f-322de37938a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:55.099362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 87/185] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:55.107305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.107305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.107305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.118407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04766aae-e4c5-46bb-a543-6dab07b25a90 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.124982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:55.126242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:55.144100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.157814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.158422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.158701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.160433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.160433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:55.160433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:55.161328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68ff3-593c-4cbf-9b50-bd327d2d502a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:55.170254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 99/186] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:55.171306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929427-9920-4662-bdef-6763b49a8eaa None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.171586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929427-9920-4662-bdef-6763b49a8eaa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.171856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929427-9920-4662-bdef-6763b49a8eaa None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.173204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 100/187] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:55.173775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7929427-9920-4662-bdef-6763b49a8eaa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.197412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.215418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 88/188] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:55.216282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.288852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7929427-9920-4662-bdef-6763b49a8eaa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.320962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.321210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c87c5-3b2e-4827-b310-a5fa2987ad35 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.321557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.321833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.322104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.322816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] RBAC: Adding query filter params (role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=cb7ed9b5bb6b47519b15cad121f36d73) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:55.323120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:55.325360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0627f1-b0fa-47c5-ab14-dd0c2a4b08c6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:55.331171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 101/189] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/role_assignments?user.id=cb7ed9b5bb6b47519b15cad121f36d73&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:55.331171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.331171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.331171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.359801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.360456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.360784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.360891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:55.361058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.362207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:55.362331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:55.363680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:55.365620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 89/190] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:55.369623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.418007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.437298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.445529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 102/191] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:55.446189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.497412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15d72-4d24-4b1e-85d5-2e54e8435273 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.541816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.542821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.542821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.542986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] PATH_INFO: `/v3/users/01276d36f39d4843a39c45a3cd9bb503` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.557935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c80df5-8a42-4e6b-8be9-1472fbd6e827 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.562193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=01276d36f39d4843a39c45a3cd9bb503)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:55.563667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:55.565593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 90/192] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/users/01276d36f39d4843a39c45a3cd9bb503 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:55.569589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.594470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.595091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.595360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.595628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.605977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:55.610702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:55.611547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:55.612301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 103/193] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:55.617451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.656851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.666416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837f360-2711-4c50-877d-e7a9b02ab0f1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.680517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.701910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.702510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.702791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.703062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.703697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:55.705166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:55.723305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd76395-0c39-4f03-a2e8-00c14fb877f7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.732071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 91/194] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:55 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:55.732933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.776026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.776694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.776969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.777967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.792496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:55.797332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:55.798283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:06:55.799124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 104/195] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:55.802910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:55.860835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0ba4-c4cd-403c-bded-6eba961195df None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.900550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.901329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.901722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.902274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.913301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.917107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c89507-1782-4ed5-bf08-9a0c6c8393db None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:55.951418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:55.957080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:55.957655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:55.958136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:55.958400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:55.959064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:55.959361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:55.960764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:55.972725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 105/196] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:55.974236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.002561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.004051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.115169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0c66-26d8-45eb-817c-8f3edb022ab2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.123304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 92/197] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:56.124083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.161378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.161990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.162267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.162540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.163207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:56.163511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.164935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.174159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 106/198] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:56.175298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.203348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.211824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.252614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d58fd-26cb-4012-b619-1c286d09ab05 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.296729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.297894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.298351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.298765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] PATH_INFO: `/v3/users/01276d36f39d4843a39c45a3cd9bb503` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.299547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329228-239c-4183-a6bf-3413b21e1d29 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.300224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] RBAC: Authorizing `identity:get_user(user_id=01276d36f39d4843a39c45a3cd9bb503)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.302829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.304697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 93/199] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/users/01276d36f39d4843a39c45a3cd9bb503 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:56.305639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.340697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.341974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.342352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.342723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.344635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.346413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.348771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 107/200] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:56.349893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.440056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ba3a-7a66-4f6a-91d6-4d6fd4a15459 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.458942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.470520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638963-092f-43b1-823f-1d554c1d0675 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.477503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.478138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.478414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.478686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] PATH_INFO: `/v3/users/64fb03e8318f4699a68844383e7a5025` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.479811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] RBAC: Authorizing `identity:get_user(user_id=64fb03e8318f4699a68844383e7a5025)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.481837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.483831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 94/201] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/users/64fb03e8318f4699a68844383e7a5025 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:56.484590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.492877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.512825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.513844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.514365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.514781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.587909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c995f0-f31a-4f2a-8d02-9352b434f65f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.592925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.594950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.624055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.624695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.624973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.625244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.625970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=01276d36f39d4843a39c45a3cd9bb503) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:56.626356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.627711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.633470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 95/202] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/role_assignments?user.id=01276d36f39d4843a39c45a3cd9bb503&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:56.634259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.703022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.716128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 108/203] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:56.722391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.800043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.871239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e5ec5-9713-455b-90db-2c94b124179f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.904304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55fabe-1cc0-4fd4-8381-67f89b0dee3d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:56.940191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.940838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.941112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.941377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.947002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:56.948692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.949172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.950096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.952196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:56.957916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:56.959895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 109/204] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:56.968229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.062006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.110626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63081-ff63-4180-be9c-5644c6571eba None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.110861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.112216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.153199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.154051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.154609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.155900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.159548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] RBAC: Adding query filter params (role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=01276d36f39d4843a39c45a3cd9bb503) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:57.160972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.162727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.174446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 110/205] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/role_assignments?user.id=01276d36f39d4843a39c45a3cd9bb503&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:57.231511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.265824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 96/206] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:57.271443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.399627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ead18-99f6-4472-97cd-b6a6a49cafaf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.424998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.446860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b90c1f-275a-4da8-a246-374c4181aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.447859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b90c1f-275a-4da8-a246-374c4181aae6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.448339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b90c1f-275a-4da8-a246-374c4181aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.449457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b90c1f-275a-4da8-a246-374c4181aae6 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.450999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b90c1f-275a-4da8-a246-374c4181aae6 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.452697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b90c1f-275a-4da8-a246-374c4181aae6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.454563 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 111/207] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:57.461661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.580640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27040-ec6d-41c4-b22e-8936dd132e71 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.615881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.616490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.616790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.617054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.617764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] RBAC: Adding query filter params (role.id=cfc7a3168b4e41e5bf325e24e770bedc, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97, user.id=64fb03e8318f4699a68844383e7a5025) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:57.618066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.619510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1f345-a6da-4b02-9581-ba30884f992a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.626112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 97/208] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/role_assignments?user.id=64fb03e8318f4699a68844383e7a5025&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=cfc7a3168b4e41e5bf325e24e770bedc => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.174093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c7000-bfde-4044-ba3a-677b2cad3a9e None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.174593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c7000-bfde-4044-ba3a-677b2cad3a9e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.174665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c7000-bfde-4044-ba3a-677b2cad3a9e None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.176110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 112/209] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:58.181492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.182296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.182760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.203018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:58.204529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:58.233611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.242936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d6bec-371d-4aff-977a-7263a2598930 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.243223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d6bec-371d-4aff-977a-7263a2598930 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.243507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d6bec-371d-4aff-977a-7263a2598930 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.245157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 113/210] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:58.259735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50138-2eb2-4d72-a361-285785558047 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.260012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50138-2eb2-4d72-a361-285785558047 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.260288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50138-2eb2-4d72-a361-285785558047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.284629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 98/211] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:58.287821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-dba50138-2eb2-4d72-a361-285785558047 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:58.289208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-dba50138-2eb2-4d72-a361-285785558047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:58.309177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.382644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 114/212] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:58.407298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50138-2eb2-4d72-a361-285785558047 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.418066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fe3ce-6ce2-4944-9cf4-e59572abe40e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.454931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.455585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.455889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.456230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.471082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:58.477613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:58.478469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:58.479251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 99/213] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:58.486008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.519434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50138-2eb2-4d72-a361-285785558047 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.542256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.556747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.560071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.561439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.562228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.562642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.564290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.565920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.567642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 115/214] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:58.573245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.594784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af380b7-dff3-4289-b36a-d0fbbaaf94fa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.631623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.632232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.632503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.632799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.633489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:58.633788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.635173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.643967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 100/215] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:58.649726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.689844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bea3c0-a6c0-4c13-aaf2-3544e0d11007 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.726367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.727201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.727622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.728035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.728881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.731161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.747041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.759071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e445f5-c463-439e-aee5-f58e68b814a1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.759226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 116/216] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:58 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:06:58.809492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a887-b5fc-44ef-9224-b8e28adbc8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.810249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a887-b5fc-44ef-9224-b8e28adbc8ba None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.810527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a887-b5fc-44ef-9224-b8e28adbc8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.810798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a887-b5fc-44ef-9224-b8e28adbc8ba None admin] PATH_INFO: `/v3/users/99c5e544d99e40aea65dc8b6260b2954` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.827730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48a887-b5fc-44ef-9224-b8e28adbc8ba None admin] RBAC: Authorizing `identity:get_user(user_id=99c5e544d99e40aea65dc8b6260b2954)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.829518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48a887-b5fc-44ef-9224-b8e28adbc8ba None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.836040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 101/217] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/users/99c5e544d99e40aea65dc8b6260b2954 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.837594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.846175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86d07-7b21-43af-a6f2-c78ec8c0f1ef None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.846459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86d07-7b21-43af-a6f2-c78ec8c0f1ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.846724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86d07-7b21-43af-a6f2-c78ec8c0f1ef None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.848604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 102/218] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:58.853880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751168e-9153-4972-a2be-b6464d84172d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.854159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751168e-9153-4972-a2be-b6464d84172d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.854449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751168e-9153-4972-a2be-b6464d84172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.873745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e751168e-9153-4972-a2be-b6464d84172d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:58.874962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e751168e-9153-4972-a2be-b6464d84172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:58.900422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.968763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 103/219] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:58.986524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2367594-1bba-4480-8115-b9db45f9c0a4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.993258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751168e-9153-4972-a2be-b6464d84172d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.035611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.035812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.036021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.036295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.083775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.118964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751168e-9153-4972-a2be-b6464d84172d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.130186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.131688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.161383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.162021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.162307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.162571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.176641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:59.181358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:59.182880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:06:59.184206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 104/220] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:59.189256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.192349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.264197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 117/221] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:59.271186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.317074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95100-a299-485b-a3ad-46bed205731c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.382554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.383223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.383501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.383772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.384438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:59.384763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.386155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.387858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.400004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 105/222] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:59.406255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.436121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb86208-a64c-490c-997f-618c1db34931 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.493288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96f4b0-a0d3-4c9d-872b-40d13f7875da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.493922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f4b0-a0d3-4c9d-872b-40d13f7875da None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.494205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f4b0-a0d3-4c9d-872b-40d13f7875da None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.494450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f4b0-a0d3-4c9d-872b-40d13f7875da None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.495707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96f4b0-a0d3-4c9d-872b-40d13f7875da None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.499072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96f4b0-a0d3-4c9d-872b-40d13f7875da None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.501273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 118/223] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.507294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08bc8-d011-4c64-b9f4-69c4010c9232 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.507535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08bc8-d011-4c64-b9f4-69c4010c9232 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.507783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08bc8-d011-4c64-b9f4-69c4010c9232 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.509370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 119/224] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:59.510081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08bc8-d011-4c64-b9f4-69c4010c9232 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.526224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.574810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc91a-36d9-40aa-b92b-d58d1f8da153 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.618080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75e75-552f-48f0-bd1a-13aafea561ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.618714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75e75-552f-48f0-bd1a-13aafea561ae None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.618991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75e75-552f-48f0-bd1a-13aafea561ae None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.619265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75e75-552f-48f0-bd1a-13aafea561ae None admin] PATH_INFO: `/v3/users/01276d36f39d4843a39c45a3cd9bb503` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.620396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75e75-552f-48f0-bd1a-13aafea561ae None admin] RBAC: Authorizing `identity:get_user(user_id=01276d36f39d4843a39c45a3cd9bb503)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.622932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75e75-552f-48f0-bd1a-13aafea561ae None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.629708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 106/225] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/users/01276d36f39d4843a39c45a3cd9bb503 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.629708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.629708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.629708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.645155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08bc8-d011-4c64-b9f4-69c4010c9232 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.647873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:59.649280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:59.691806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.692417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.692733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.693008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.693738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=99c5e544d99e40aea65dc8b6260b2954) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:59.694044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.696100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.704082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 120/226] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/role_assignments?user.id=99c5e544d99e40aea65dc8b6260b2954&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.705275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.734848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.756415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 107/227] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:59.798373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.807588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.833747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c53a5-c173-4ee4-be6d-ec3845fbc188 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.873686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.874676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.875010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.875290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.876532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.878239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.880692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 121/228] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.889359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:00.015209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159444f-f260-439f-9754-ee5ece966da3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.066165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee345e-205a-4591-9c4a-0679bd78c651 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.082250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.082890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.083160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.083425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.104859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:00.111717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:00.112621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:00.113397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:00.115261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 108/229] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:00.121221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:00.136127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.136910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.137191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.137458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c/users/01276d36f39d4843a39c45a3cd9bb503/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.141612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] RBAC: Authorizing `identity:create_grant(project_id=657e59a772544e5a86344efc58b46b9c, user_id=01276d36f39d4843a39c45a3cd9bb503, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:00.144839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:00.170783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 122/230] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:06:59 2022] PUT /identity/v3/projects/657e59a772544e5a86344efc58b46b9c/users/01276d36f39d4843a39c45a3cd9bb503/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:07:00.232988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:00.299777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352259f2-ea02-4139-b3f5-e5d5177d8a51 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.350967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.351514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.351794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.352068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.352764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:00.353068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:00.354470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:00.364297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 109/231] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:00.370032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:00.376737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:00.488175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622472c9-4db4-41d9-8c07-49d7ebe4befc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.525425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.526065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.526342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.526615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] PATH_INFO: `/v3/users/01276d36f39d4843a39c45a3cd9bb503` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.528233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] RBAC: Authorizing `identity:get_user(user_id=01276d36f39d4843a39c45a3cd9bb503)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:00.529717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:00.531628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 123/232] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:00 2022] GET /identity/v3/users/01276d36f39d4843a39c45a3cd9bb503 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:00.537648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:00.657872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3b137-a628-41de-916a-2a130d0a9b62 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.675511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:00.695352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc313b-1325-4641-8e49-412fe174116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.696328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc313b-1325-4641-8e49-412fe174116b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.696881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc313b-1325-4641-8e49-412fe174116b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.697404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc313b-1325-4641-8e49-412fe174116b None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.698780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc313b-1325-4641-8e49-412fe174116b None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:00.700580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc313b-1325-4641-8e49-412fe174116b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:00.702717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 110/233] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:00 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:00.708249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:00.836491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:00.881181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57824b-eb4a-4ecc-835d-2de9277a6d92 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.928197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f18fa5-ebb9-406d-8f5d-bd11405bff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.929206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f18fa5-ebb9-406d-8f5d-bd11405bff68 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.929681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f18fa5-ebb9-406d-8f5d-bd11405bff68 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.930160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f18fa5-ebb9-406d-8f5d-bd11405bff68 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c/users/01276d36f39d4843a39c45a3cd9bb503/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.934714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f18fa5-ebb9-406d-8f5d-bd11405bff68 None admin] RBAC: Authorizing `identity:create_grant(project_id=657e59a772544e5a86344efc58b46b9c, user_id=01276d36f39d4843a39c45a3cd9bb503, role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:00.936406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f18fa5-ebb9-406d-8f5d-bd11405bff68 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:00.956868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 124/234] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:00 2022] PUT /identity/v3/projects/657e59a772544e5a86344efc58b46b9c/users/01276d36f39d4843a39c45a3cd9bb503/roles/709c5429fa39482fa0cd40f9104ce17d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:01.295707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb8da-941b-4140-997c-1ced572f7b6b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.296794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb8da-941b-4140-997c-1ced572f7b6b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.297299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb8da-941b-4140-997c-1ced572f7b6b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.299158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 111/235] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:01.304207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.304732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.305218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.325519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:01.327018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:01.413859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 125/236] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:01.456793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb8da-941b-4140-997c-1ced572f7b6b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:01.606298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb8da-941b-4140-997c-1ced572f7b6b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:01.641886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563614df-e847-4bd7-a835-4a63dda6ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:01.642519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563614df-e847-4bd7-a835-4a63dda6ee7f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.642790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563614df-e847-4bd7-a835-4a63dda6ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.643053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563614df-e847-4bd7-a835-4a63dda6ee7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.655426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563614df-e847-4bd7-a835-4a63dda6ee7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-563614df-e847-4bd7-a835-4a63dda6ee7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:01.660264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:01.661154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:01.661932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:01.665931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 112/237] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:01.668361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:01.741386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:01.771047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ab6e-1d32-4df2-b1d1-e0f23e2d60b1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.771320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ab6e-1d32-4df2-b1d1-e0f23e2d60b1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.771592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ab6e-1d32-4df2-b1d1-e0f23e2d60b1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.772941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 113/238] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:01.782081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.782351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.782669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.799659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90525de9-d8e9-4ad7-a299-569d23271a8b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:01.810000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:01.811321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:01.838051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:01.838724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.839000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.839269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.840252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:01.840598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:01.845651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:01.866083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 126/239] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:01.871081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:01.908940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:01.957880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 114/240] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:02.002674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b876b-02c9-414d-bfee-baf6455c3fdf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.009599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.029804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.043168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.043804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.044121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.044444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] PATH_INFO: `/v3/users/ab499bbb83a24ff2b6d9e42e3369f778` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.059117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ab499bbb83a24ff2b6d9e42e3369f778)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.060645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.062627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 127/241] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:01 2022] GET /identity/v3/users/ab499bbb83a24ff2b6d9e42e3369f778 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.070169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.191521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6d9b-9f28-4b1b-818d-4399071f112d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.234537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad32f-3fdd-4b8d-a843-fc64728436c6 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.241072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5317d5-e800-4774-816f-4e1ad003b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.241721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5317d5-e800-4774-816f-4e1ad003b882 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.241995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5317d5-e800-4774-816f-4e1ad003b882 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.242263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5317d5-e800-4774-816f-4e1ad003b882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.243913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5317d5-e800-4774-816f-4e1ad003b882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.245974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5317d5-e800-4774-816f-4e1ad003b882 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.248434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 115/242] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:02.249753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ceb82-9be4-4e40-8bf6-ac64388c9b32 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.250030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ceb82-9be4-4e40-8bf6-ac64388c9b32 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.252770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ceb82-9be4-4e40-8bf6-ac64388c9b32 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.254029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 116/243] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:02.258673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ceb82-9be4-4e40-8bf6-ac64388c9b32 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.282703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.283321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.283593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.283871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.329180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.365232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.397404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.399467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.419368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ceb82-9be4-4e40-8bf6-ac64388c9b32 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.467303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f68f-ba5b-44b0-a6a0-609e029f97e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.468643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f68f-ba5b-44b0-a6a0-609e029f97e9 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.469130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f68f-ba5b-44b0-a6a0-609e029f97e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.469578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f68f-ba5b-44b0-a6a0-609e029f97e9 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.470555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f68f-ba5b-44b0-a6a0-609e029f97e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.473436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f68f-ba5b-44b0-a6a0-609e029f97e9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.513198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 117/244] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:02 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:02.513198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad624d94-5785-470a-81a4-36122e4c9ba3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.513198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad624d94-5785-470a-81a4-36122e4c9ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.513198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad624d94-5785-470a-81a4-36122e4c9ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.548962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ad624d94-5785-470a-81a4-36122e4c9ba3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:02.550267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad624d94-5785-470a-81a4-36122e4c9ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:02.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 128/245] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:02.564786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.664294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 118/246] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:02.668455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fed1c-e329-46d4-893c-fa403d11b4d6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.668791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fed1c-e329-46d4-893c-fa403d11b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.669049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fed1c-e329-46d4-893c-fa403d11b4d6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.671949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 119/247] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:02.675033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.676256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.676256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.676524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.703156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:02.704449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:02.708318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258869-4c64-46a7-b852-8908ef947166 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.733592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.757316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.758496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.758850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.759194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.760602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.763109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.765744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 129/248] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:02.766531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.796180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 120/249] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:02.798043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.900067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b4bd-bf9e-40c5-95be-ec9eb674c1ee None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.946877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f661-446a-46c9-b0d7-dfd3f0a2fc1f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.947704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.948337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.948655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.949598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.967319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:02.973057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:02.973956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:02.974748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 130/250] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:02.976104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.991292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.000970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.001585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.001854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.002117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.002832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] RBAC: Adding query filter params (role.id=cfc7a3168b4e41e5bf325e24e770bedc, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=ab499bbb83a24ff2b6d9e42e3369f778) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:03.003134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.004635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.022863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 121/251] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/role_assignments?user.id=ab499bbb83a24ff2b6d9e42e3369f778&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=cfc7a3168b4e41e5bf325e24e770bedc => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.022863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.071295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.190952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c0260-82a1-4f90-8a75-feb80176ea69 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.236194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef32f9e-998d-4d3d-b6eb-5f20773432ff None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.244353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.244970 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.245250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.245665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.257775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:03.264443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:03.265459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:03.266266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 131/252] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:03.271595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.295232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.295847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.296121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.296387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.297131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:03.297427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.298815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.314429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 122/253] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.320230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.378087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.414867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77a54-9221-4ddb-b753-c43121ab31cf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.471046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.477221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.477591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.477936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.478429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.478866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:03.479092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.482237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.492835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdcd8-df85-40ec-9999-31ad7c258284 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.499182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 132/254] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.509619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.565284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.565940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.566217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.566489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] PATH_INFO: `/v3/users/99c5e544d99e40aea65dc8b6260b2954` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.567749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] RBAC: Authorizing `identity:get_user(user_id=99c5e544d99e40aea65dc8b6260b2954)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.569328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.570919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 123/255] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/users/99c5e544d99e40aea65dc8b6260b2954 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:03.577881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.670235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe16f-3ef6-4953-ac3e-8274ab6a2064 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.707054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.707685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.708125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.708662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] PATH_INFO: `/v3/users/01276d36f39d4843a39c45a3cd9bb503` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.709939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] RBAC: Authorizing `identity:get_user(user_id=01276d36f39d4843a39c45a3cd9bb503)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.711587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.713802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 133/256] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/users/01276d36f39d4843a39c45a3cd9bb503 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.716629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.721141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.781871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6280-cec0-4d63-8ab4-9454ddc59199 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.844275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a8116-04a2-460a-a849-01768917588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.844945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a8116-04a2-460a-a849-01768917588c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.845221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a8116-04a2-460a-a849-01768917588c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.845492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a8116-04a2-460a-a849-01768917588c None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.847334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a8116-04a2-460a-a849-01768917588c None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.849485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a8116-04a2-460a-a849-01768917588c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.857553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 124/257] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:03.863563 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a574f3b-fbcb-49dc-8f0e-5414fd86365f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.866922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a8116-04a2-460a-a849-01768917588c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.910387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.962387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b0e69-58af-4bf5-9db5-ccd791d8c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.963000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b0e69-58af-4bf5-9db5-ccd791d8c781 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.963269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b0e69-58af-4bf5-9db5-ccd791d8c781 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.963535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b0e69-58af-4bf5-9db5-ccd791d8c781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.043202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a8116-04a2-460a-a849-01768917588c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.092920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.097331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.097797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b0e69-58af-4bf5-9db5-ccd791d8c781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.098023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.098462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.098883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c/users/99c5e544d99e40aea65dc8b6260b2954/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.099305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b0e69-58af-4bf5-9db5-ccd791d8c781 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.101241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] RBAC: Authorizing `identity:create_grant(project_id=657e59a772544e5a86344efc58b46b9c, user_id=99c5e544d99e40aea65dc8b6260b2954, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.102854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.126904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 125/258] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:03 2022] PUT /identity/v3/projects/657e59a772544e5a86344efc58b46b9c/users/99c5e544d99e40aea65dc8b6260b2954/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:07:04.265262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 134/259] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:04.271132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.367361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20463e73-b9d3-4ed2-8f50-e5480f81f198 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.367553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20463e73-b9d3-4ed2-8f50-e5480f81f198 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.367805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20463e73-b9d3-4ed2-8f50-e5480f81f198 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.369340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 135/260] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:04.383642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.385306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.385718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.385991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.412634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa50a4-687d-46c9-8148-a01041a65473 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.429110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:04.430325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:04.466558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.467194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.467468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.467735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.468955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.470405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.472592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 126/261] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.478964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.564676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 136/262] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:04.588741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.630283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.653137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad113-4876-46a5-bbb9-af7ecd797ad8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.709853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.710477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.710758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.711034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.711763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=01276d36f39d4843a39c45a3cd9bb503) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:04.712079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.713568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.720736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 127/263] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/role_assignments?user.id=01276d36f39d4843a39c45a3cd9bb503&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.735174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d724b1a-5066-4d17-a7f3-2de429a6ac67 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.808616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.808616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.808616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.808616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.829188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:04.834385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:04.835258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:04.836036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 137/264] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:04.843356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.871149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.991129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0220d-e92c-4862-8081-23abf8549991 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.038060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.038918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.039331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.039755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.040546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:05.041001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.042683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.056649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 128/265] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:05.062607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.183287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.198571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d1e74-e668-4aae-88da-a1581a5b01df None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.242616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7dd0f-2a80-4365-a36c-1e970421cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.243170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7dd0f-2a80-4365-a36c-1e970421cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.243447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7dd0f-2a80-4365-a36c-1e970421cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.243715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7dd0f-2a80-4365-a36c-1e970421cfa5 None admin] PATH_INFO: `/v3/users/01276d36f39d4843a39c45a3cd9bb503` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.244859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7dd0f-2a80-4365-a36c-1e970421cfa5 None admin] RBAC: Authorizing `identity:get_user(user_id=01276d36f39d4843a39c45a3cd9bb503)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.246809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7dd0f-2a80-4365-a36c-1e970421cfa5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.248709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 138/266] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/users/01276d36f39d4843a39c45a3cd9bb503 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:05.254002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.327027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa625fd-3304-422c-bf8b-20fa907f4a9d None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.327344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa625fd-3304-422c-bf8b-20fa907f4a9d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.327558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa625fd-3304-422c-bf8b-20fa907f4a9d None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.329103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 139/267] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:05.341167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f62f85-3016-4e50-99dc-f490f34a40b3 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.341467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f62f85-3016-4e50-99dc-f490f34a40b3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.341704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f62f85-3016-4e50-99dc-f490f34a40b3 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.343241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 140/268] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:05.344711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace86f0-c416-445c-be8c-6bfc0e6b3cfb None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.344990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace86f0-c416-445c-be8c-6bfc0e6b3cfb None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.345254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace86f0-c416-445c-be8c-6bfc0e6b3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.367223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6ace86f0-c416-445c-be8c-6bfc0e6b3cfb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:05.368417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6ace86f0-c416-445c-be8c-6bfc0e6b3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:05.387385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.415621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad0226-11c4-4a49-a4d4-31975bb9166f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.463692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.464355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.464680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.464955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.469301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 141/269] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:05.470637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.470917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.471189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.489575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:05.490759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:05.554193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.555599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.568577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 142/270] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:05.569453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.591330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.664913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.690995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf7ffa-99db-4f97-9770-8d231f4d1779 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.697614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 129/271] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:05.697614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.743760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.745093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.745740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.746500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.747832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.749518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.751315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 143/272] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:05.752340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.815679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a389-ef6c-4078-9d72-0b052c9879bd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.853170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.863474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.864140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.864892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.865171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.871453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117a6f6-5c5a-4596-acc0-10486fd31efa None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.878218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:05.884400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:05.885308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:05.886177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 130/273] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:05.887137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.922280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.922934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.923314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.923696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.924833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.926435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.933488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 144/274] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:05.933488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.933779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.004305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bc7c-3d6c-4b08-9858-5f3d8619ebb5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.042988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.044018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.044633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.045120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.046110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.047909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.054079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e134f-6871-4827-8131-a558d50f2805 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.074378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 131/275] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:05 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:06.075286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.094758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.095470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.095814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.096150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.096917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:06.097217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.098675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7db7ba-2738-4f73-842d-71a2eb67a242 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.109031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 145/276] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:06.110387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e87a3-665f-4f08-8446-c295f4bd154c None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.110660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e87a3-665f-4f08-8446-c295f4bd154c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.110915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e87a3-665f-4f08-8446-c295f4bd154c None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.112606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 146/277] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:06.114290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e87a3-665f-4f08-8446-c295f4bd154c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.135739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.205310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.219454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a790d4-b032-4bbb-b0b5-e82814f7f97d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.242730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e87a3-665f-4f08-8446-c295f4bd154c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.260247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.260886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.261463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.261749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.263426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] RBAC: Adding query filter params (role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=01276d36f39d4843a39c45a3cd9bb503) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:06.263937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.265233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a41063-f627-4c3b-a85e-6f66806ab34d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.274611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 132/278] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/role_assignments?user.id=01276d36f39d4843a39c45a3cd9bb503&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:06.275881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.276166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.276437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.285784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.286521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.286885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.287225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] PATH_INFO: `/v3/users/7d6e3982ef1a4a46af046574fe7616ec` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.301295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:06.303852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:06.305387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6e3982ef1a4a46af046574fe7616ec)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.306936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.310027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 147/279] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/users/7d6e3982ef1a4a46af046574fe7616ec => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:06.322511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.400894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 133/280] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:06.432861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.441082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.477371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79c1b-e1e2-4b8e-9228-fcf3bab80e34 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.524633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.525720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.526121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.526486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.527408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, user.id=7d6e3982ef1a4a46af046574fe7616ec, scope.system=all) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:06.527810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.529421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.535997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 148/281] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/role_assignments?user.id=7d6e3982ef1a4a46af046574fe7616ec&scope.system=all&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:06.544196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.564984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6a64-7799-4954-a32e-b6d505becccb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.607511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.608463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.608936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.609403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.622681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:06.627581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:06.628529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:06.629557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 134/282] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:06.637506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.753892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7f3b4-355d-4547-a172-f68baa2c3486 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.794319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.797657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.797657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.797657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.797657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:06.797657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.798148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a792e-b369-4f7d-96c0-58130cc286cd None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.808586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 149/283] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:06.812043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.813406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.037946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710433-8a5c-4ce0-ba29-68e203fca605 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.040858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff20d1d-f823-4e3b-b941-330ee7151547 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.041142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff20d1d-f823-4e3b-b941-330ee7151547 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.041417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff20d1d-f823-4e3b-b941-330ee7151547 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.043504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 150/284] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:07.049447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.050004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.050476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.087225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:07.088447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:07.115873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.116519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.116822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.117099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] PATH_INFO: `/v3/users/ab499bbb83a24ff2b6d9e42e3369f778` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.121778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] RBAC: Authorizing `identity:get_user(user_id=ab499bbb83a24ff2b6d9e42e3369f778)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.123240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.125189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 135/285] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/users/ab499bbb83a24ff2b6d9e42e3369f778 => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:07.130546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.159769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.162730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 151/286] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:07.187271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.267087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d1f9d-17bb-4a2a-8587-742df2cf8b40 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.309244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.309813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.310092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.310364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.312207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.313697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.315564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 136/287] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:07.321392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.352522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1028f-1586-4739-a5ce-e8e50d76b6fa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.382385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.397263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.397893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.398164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.398431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.412911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.423604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:07.428328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:07.429244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:07.430036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:07.432762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8cee-bd38-4404-b4b0-5c70f483f849 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.437914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 152/288] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:07.444657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.469126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.469842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.470121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.470395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c/users/ab499bbb83a24ff2b6d9e42e3369f778/roles/cfc7a3168b4e41e5bf325e24e770bedc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.477589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] RBAC: Authorizing `identity:create_grant(project_id=657e59a772544e5a86344efc58b46b9c, user_id=ab499bbb83a24ff2b6d9e42e3369f778, role_id=cfc7a3168b4e41e5bf325e24e770bedc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.479045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.509989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 137/289] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:07 2022] PUT /identity/v3/projects/657e59a772544e5a86344efc58b46b9c/users/ab499bbb83a24ff2b6d9e42e3369f778/roles/cfc7a3168b4e41e5bf325e24e770bedc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:07:07.587357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e1fd9-b2a3-4a9c-903d-c7c6c14ea450 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.631834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.632455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.632759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.633034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.633720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:07.634025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.635456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.646155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 153/290] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:07.653361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.775854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcd053-5fee-4326-a85e-4eeb7090c52f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.824475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.825511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.826026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.826492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] PATH_INFO: `/v3/users/99c5e544d99e40aea65dc8b6260b2954` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.827894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] RBAC: Authorizing `identity:get_user(user_id=99c5e544d99e40aea65dc8b6260b2954)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.829576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.836432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 138/291] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/users/99c5e544d99e40aea65dc8b6260b2954 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:07.841854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.932534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.992637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f6b0-ec8a-4e4d-8aba-25259c313d4d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.031712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.032324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.032621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.032901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.140620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.141988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.211581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:08.277891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 154/292] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:08.283757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.304331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:08.524806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffb8a-efc8-4cc5-9703-c4a3c06d2920 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.580114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77f9b7-ec81-4462-82b4-e6acb0f681fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.580782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f9b7-ec81-4462-82b4-e6acb0f681fd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.581065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f9b7-ec81-4462-82b4-e6acb0f681fd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.581342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f9b7-ec81-4462-82b4-e6acb0f681fd None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.582474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77f9b7-ec81-4462-82b4-e6acb0f681fd None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.583937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77f9b7-ec81-4462-82b4-e6acb0f681fd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.585817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 139/293] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:08 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:08.591992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.704746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c98d73-8e4a-42ac-a212-a984d84686df None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.753451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.754059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.754335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.754604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.755327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=99c5e544d99e40aea65dc8b6260b2954) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:08.755629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.757080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492fb5c-c9e5-44af-947f-8ae9f509cbbb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.766701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 155/294] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:08 2022] GET /identity/v3/role_assignments?user.id=99c5e544d99e40aea65dc8b6260b2954&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:08.901359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9af6b-657a-44b0-8916-8b1443ee94a5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.902704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9af6b-657a-44b0-8916-8b1443ee94a5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.902704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9af6b-657a-44b0-8916-8b1443ee94a5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.904111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 140/295] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:08.909742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a1f2-2ba7-4f08-a732-6482b1686320 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.910224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a1f2-2ba7-4f08-a732-6482b1686320 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.910295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a1f2-2ba7-4f08-a732-6482b1686320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.934746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fc91a1f2-2ba7-4f08-a732-6482b1686320 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:08.935982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fc91a1f2-2ba7-4f08-a732-6482b1686320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:08.953742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.031359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 156/296] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:09.054047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9af6b-657a-44b0-8916-8b1443ee94a5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.132971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656d72-5670-4316-a5d8-42841e61d0e2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.133279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656d72-5670-4316-a5d8-42841e61d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.133507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec656d72-5670-4316-a5d8-42841e61d0e2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.135082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 157/297] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:09.140214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.140677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e206-1193-4c0f-a2da-29a1cc2535a0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.140959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e206-1193-4c0f-a2da-29a1cc2535a0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.141228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e206-1193-4c0f-a2da-29a1cc2535a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.162158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3127e206-1193-4c0f-a2da-29a1cc2535a0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:09.163339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3127e206-1193-4c0f-a2da-29a1cc2535a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:09.165909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9af6b-657a-44b0-8916-8b1443ee94a5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.201720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.202365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.202649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.202925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.213503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:09.218560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:09.219444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:09.220360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 141/298] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:09.226994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.248633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 158/299] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:09.250142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24548b-4061-415c-8a1c-07d524617d2b None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.250429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24548b-4061-415c-8a1c-07d524617d2b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.250704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24548b-4061-415c-8a1c-07d524617d2b None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.252069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 159/300] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:09.257521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.258013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.277606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:09.279119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:09.357598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a47ed-016b-4615-8874-781f18772d57 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.361095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 160/301] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:09.369424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.379992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.397138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.397749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.398025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.398303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.398969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:09.399273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.400936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.403808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.411386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 142/302] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:09.416651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.502377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9e2cf-b757-4c9e-b884-8f5938040112 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.538777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.539413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.539690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.539959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.545222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a06f8c-0d1c-4386-b629-d4dd2a86cc90 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.559782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:09.564612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:09.565481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:09.566262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 161/303] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:09.566909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.585656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.586366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.586712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.587052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.588215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.590480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.596622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 143/304] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.596622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.665937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.675400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.708213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9e276-97b9-4999-b722-aa61833d9916 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.723668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea39a0-e853-49bd-a59a-4f83c6c8cbac None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.748498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.749160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.749435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.749703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] PATH_INFO: `/v3/users/d56eda00d32a4d578db04195498da387` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.765035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.765738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.766115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.766457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.767185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:09.767610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.768298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] RBAC: Authorizing `identity:get_user(user_id=d56eda00d32a4d578db04195498da387)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.769159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.770226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.773057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 162/305] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/users/d56eda00d32a4d578db04195498da387 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.774060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.784217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 144/306] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.785229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.907070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5ee2e-595b-4ed4-959d-13d1b37bb3bf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.915386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69c728-3e0c-4dca-a62f-b607876575a4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.931701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.944501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f789ee-33b4-4679-a962-8cbfbc7895f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.945099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.945204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f789ee-33b4-4679-a962-8cbfbc7895f5 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.945450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f789ee-33b4-4679-a962-8cbfbc7895f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.945730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f789ee-33b4-4679-a962-8cbfbc7895f5 None admin] PATH_INFO: `/v3/groups` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.946386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f789ee-33b4-4679-a962-8cbfbc7895f5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.947822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f789ee-33b4-4679-a962-8cbfbc7895f5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.955709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.956638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.956968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.957276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.958102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] RBAC: Adding query filter params (role.id=cfc7a3168b4e41e5bf325e24e770bedc, user.id=d56eda00d32a4d578db04195498da387, scope.system=all) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:09.958409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.959950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.972625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 145/308] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/role_assignments?user.id=d56eda00d32a4d578db04195498da387&scope.system=all&role.id=cfc7a3168b4e41e5bf325e24e770bedc => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.972625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.972935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 163/308] 10.222.0.25 () {60 vars in 1134 bytes} [Sun Aug 7 18:07:09 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:09.989152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb4ef2-7f58-4cbc-9f5a-b7f221a4d529 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.989631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb4ef2-7f58-4cbc-9f5a-b7f221a4d529 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.990012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb4ef2-7f58-4cbc-9f5a-b7f221a4d529 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.992174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 164/309] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:09.998764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.999092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.999317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.025568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:10.026935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:10.128744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 165/310] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:10.137969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7b1d-5ef2-49d9-811e-494e1bd57294 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.152433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.188424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.189070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.189346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.189614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] PATH_INFO: `/v3/users/7d6e3982ef1a4a46af046574fe7616ec` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.190727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6e3982ef1a4a46af046574fe7616ec)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.192187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.194151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 146/311] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/users/7d6e3982ef1a4a46af046574fe7616ec => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.199536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.283327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a99bda-77e6-438e-bc6c-4f4ac51d54d5 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.288041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.298833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.321801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.322430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.322703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.322971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.335046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:10.341672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6526f84-f46d-45a3-8d77-b2301b3f7069 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:10.341816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:10.343039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:10.343973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 166/312] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:10.350490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.390508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.391266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.391614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.391956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] PATH_INFO: `/v3/system/users/7d6e3982ef1a4a46af046574fe7616ec/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.393904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7d6e3982ef1a4a46af046574fe7616ec, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.395791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.409605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 147/313] 10.222.0.25 () {58 vars in 1334 bytes} [Sun Aug 7 18:07:10 2022] PUT /identity/v3/system/users/7d6e3982ef1a4a46af046574fe7616ec/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:10.469793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00739-bdad-450c-b322-1caf424b8281 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.507984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.508679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.508948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.509211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.510216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:10.510216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.511809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.521319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 167/314] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:10.528392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.635707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803b3d-2707-424b-b9af-4413207f17e2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.660294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.673175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.673805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.674080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.674350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] PATH_INFO: `/v3/users/ab499bbb83a24ff2b6d9e42e3369f778` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.675476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] RBAC: Authorizing `identity:get_user(user_id=ab499bbb83a24ff2b6d9e42e3369f778)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.676961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.678537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 148/315] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/users/ab499bbb83a24ff2b6d9e42e3369f778 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.684552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.725210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.807919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0507f-31a8-4114-868f-200d1cf50f00 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.843999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.844630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.844913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.845187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.917119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.919229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.956140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.023085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 168/316] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:11.029706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.134481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88aa5-f749-4b63-9c50-3f4a31e0a031 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.170618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd02dc-951d-4ef9-a960-355a213947ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.171286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd02dc-951d-4ef9-a960-355a213947ec None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.171562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd02dc-951d-4ef9-a960-355a213947ec None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.171833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd02dc-951d-4ef9-a960-355a213947ec None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.173142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd02dc-951d-4ef9-a960-355a213947ec None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.174762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd02dc-951d-4ef9-a960-355a213947ec None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.180748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 149/317] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.184077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.290861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fc8d-6158-410e-8f94-1d41523c0113 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.325160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.325838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.326109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.326373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.327086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] RBAC: Adding query filter params (role.id=cfc7a3168b4e41e5bf325e24e770bedc, scope.project.id=657e59a772544e5a86344efc58b46b9c, user.id=ab499bbb83a24ff2b6d9e42e3369f778) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:11.327387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.328841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ae39-416c-4059-b2e3-5ef86d676a80 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.331743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.335124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 169/318] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/role_assignments?user.id=ab499bbb83a24ff2b6d9e42e3369f778&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=cfc7a3168b4e41e5bf325e24e770bedc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.094724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079508-d4b6-4d74-af37-2a35ad23ba7a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.095265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079508-d4b6-4d74-af37-2a35ad23ba7a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.095265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079508-d4b6-4d74-af37-2a35ad23ba7a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.096530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 150/319] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:12.101976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.102455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.102697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.121848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:12.123016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:12.131017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6130-fa9a-46cf-a948-32445a598daa None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.131303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6130-fa9a-46cf-a948-32445a598daa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.131574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6130-fa9a-46cf-a948-32445a598daa None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.133194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 151/320] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:12.138726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.139006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.139290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.156987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:12.158157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:12.195589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 170/321] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:12.216356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.218947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.231904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 152/322] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:12.253349 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.324672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb78711-ae4e-441c-9bfb-c61831d48a5e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.358057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.365481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.366276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.366867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.367151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.368419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.369410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcec2f-bc6c-4bbb-9d34-36d218957b1b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.369886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.372856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 171/323] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.378754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.410656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.411283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.411561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.411824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.422887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:12.427555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:12.428433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:12.429249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:12.434036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 153/324] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:12.435144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.487706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.494119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447b02-ca4a-400f-a016-c1ab5134bb90 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.534957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ee1f-7683-47d4-9c05-f0c2184b5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.535556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ee1f-7683-47d4-9c05-f0c2184b5f20 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.535834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ee1f-7683-47d4-9c05-f0c2184b5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.536106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ee1f-7683-47d4-9c05-f0c2184b5f20 None admin] PATH_INFO: `/v3/groups` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.536762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ee1f-7683-47d4-9c05-f0c2184b5f20 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.538207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ee1f-7683-47d4-9c05-f0c2184b5f20 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.544623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c115cbb-c9ae-49d6-b6ad-ae4903f86f9b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.553063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 172/325] 10.222.0.25 () {60 vars in 1134 bytes} [Sun Aug 7 18:07:12 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:07:12.554567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de03ea-9b1f-4a37-b6cf-187db9a43dfa None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.554852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de03ea-9b1f-4a37-b6cf-187db9a43dfa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.555118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de03ea-9b1f-4a37-b6cf-187db9a43dfa None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.556482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 173/326] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:12.561940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.562244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.562483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.581238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:12.582491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:12.583076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.583738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.584017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.584311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.585010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:12.585323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.586763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.600448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 154/327] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.602004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.645505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.662808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 174/328] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:12.686351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.717907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0b72-96a4-42e5-859c-075c6f7b3ac2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.734531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.760178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.760980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.762004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.762004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] PATH_INFO: `/v3/users/d56eda00d32a4d578db04195498da387` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.763149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d56eda00d32a4d578db04195498da387)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.765172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.766435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 155/329] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/users/d56eda00d32a4d578db04195498da387 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.772378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.806401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd62d-7182-4a6b-a965-d5650328f185 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.849052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.850009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.850466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.850936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.862441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:12.867308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:12.868177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:12.869013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 175/330] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:12.876975 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.899939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1d927-7ef9-4651-a4d6-5896475b41f8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.945039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.952680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.952966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.953195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.953462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] PATH_INFO: `/v3/system/users/d56eda00d32a4d578db04195498da387/roles/cfc7a3168b4e41e5bf325e24e770bedc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.955575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d56eda00d32a4d578db04195498da387, role_id=cfc7a3168b4e41e5bf325e24e770bedc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.956997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.965152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 156/331] 10.222.0.25 () {58 vars in 1334 bytes} [Sun Aug 7 18:07:12 2022] PUT /identity/v3/system/users/d56eda00d32a4d578db04195498da387/roles/cfc7a3168b4e41e5bf325e24e770bedc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:13.009818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea81a-4856-4cc8-9db0-282712fccff8 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.053093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.053712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.053981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.054255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.054912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:13.055208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.056617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.066240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 176/332] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:13.074177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.130984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:13.194245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ac78-a768-4f05-b98a-d6c1a1accd3d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.234027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dcf17-eb6a-4f29-818f-5d9fe58d92b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.234660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dcf17-eb6a-4f29-818f-5d9fe58d92b7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.234932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dcf17-eb6a-4f29-818f-5d9fe58d92b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.235198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dcf17-eb6a-4f29-818f-5d9fe58d92b7 None admin] PATH_INFO: `/v3/users/7d6e3982ef1a4a46af046574fe7616ec` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.236402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dcf17-eb6a-4f29-818f-5d9fe58d92b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6e3982ef1a4a46af046574fe7616ec)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.237770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dcf17-eb6a-4f29-818f-5d9fe58d92b7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.239644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 157/333] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/users/7d6e3982ef1a4a46af046574fe7616ec => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:13.245291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.364144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817e0cd-a79c-49f2-8d13-151f8c0d5985 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.375619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:13.409393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.410076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.410350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.410618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.411408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] RBAC: Adding query filter params (role.id=7969717fb22c46249a430b8bd7e844c4, user.id=7d6e3982ef1a4a46af046574fe7616ec, scope.system=all) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:13.411711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.413175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f21be-8c4e-45c3-a75b-70aa4f5341d9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.429649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 177/334] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/role_assignments?user.id=7d6e3982ef1a4a46af046574fe7616ec&scope.system=all&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:14.860330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c96a-7796-4160-bcce-879652561f09 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.860869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c96a-7796-4160-bcce-879652561f09 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.860869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c96a-7796-4160-bcce-879652561f09 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.862448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 158/335] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:14.870053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.871886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.872354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.902047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:14.903560 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:14.974725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 178/336] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:15.012380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c96a-7796-4160-bcce-879652561f09 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.140683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c96a-7796-4160-bcce-879652561f09 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.154665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.179600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.180242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.180517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.180832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.192923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:15.197708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:15.199168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:15.199943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:15.200585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 159/337] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:15.205731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.371523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.375811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b87e8-a195-43d7-9c9f-a9314dc22c80 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.414381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.414911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.415183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.415451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.416118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:15.416412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.418625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1379-4bfd-44a9-a878-ca88dbae31b8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.432155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 179/338] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:15.437912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.487280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb82e4-5979-4db1-bfa6-477b61a32035 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.487579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb82e4-5979-4db1-bfa6-477b61a32035 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.487814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb82e4-5979-4db1-bfa6-477b61a32035 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.489294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 180/339] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:15.506635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.506635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.506635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.534025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:15.535573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:15.555840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc308b-4d39-4087-b3ad-8b19b9ef0d87 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.592333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.593090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.593373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.593697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.638525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.669637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.671383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.675737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 181/340] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:15.715391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.778155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 160/341] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:15.783955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.877479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.882557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a298e-bd79-4fe8-ba6c-93daedba0c22 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.919501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.929377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.931200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.933631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.933942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.962067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:15.967976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:15.968859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:15.969654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 182/342] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:15.975385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.982108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0955a6-bea7-4ee9-93f3-24aea9816b7b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.027594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.028664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.029137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.029600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.031624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.033915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.035930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 161/343] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:16.046937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.176984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c6f72-8c43-4cfa-a0a0-27e49855d56d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.231600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17a45-0903-4f17-98be-5c69e13d3e00 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.236037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.236864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.237312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.237728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.238548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:16.238995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.240509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83195a24-6b2f-41fd-bfe2-d4dcca8a344d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.253770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 183/344] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.256173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ede7-c8b6-43eb-bb9b-2f6c79a79cf0 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.256671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ede7-c8b6-43eb-bb9b-2f6c79a79cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.257123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ede7-c8b6-43eb-bb9b-2f6c79a79cf0 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.258856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 184/345] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:16.260096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971009-39e0-49c6-902c-c851998fac6a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.260554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971009-39e0-49c6-902c-c851998fac6a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.261545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971009-39e0-49c6-902c-c851998fac6a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.262903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 185/346] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:16.263782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971009-39e0-49c6-902c-c851998fac6a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.284311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.288136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d30a-8de8-4d72-b5c4-dffe2d1821a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.289295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d30a-8de8-4d72-b5c4-dffe2d1821a2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.289895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d30a-8de8-4d72-b5c4-dffe2d1821a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.290409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d30a-8de8-4d72-b5c4-dffe2d1821a2 None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.299825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879d30a-8de8-4d72-b5c4-dffe2d1821a2 None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.302356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879d30a-8de8-4d72-b5c4-dffe2d1821a2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.305484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 162/347] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.307555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac140b5-836c-4ae8-98ee-5ddded7288b0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.309258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac140b5-836c-4ae8-98ee-5ddded7288b0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.309928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac140b5-836c-4ae8-98ee-5ddded7288b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.328938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.339706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7ac140b5-836c-4ae8-98ee-5ddded7288b0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:16.341222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7ac140b5-836c-4ae8-98ee-5ddded7288b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:16.416913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971009-39e0-49c6-902c-c851998fac6a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.439934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 163/348] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:16.441239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.441527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.441807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.463766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:16.466186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:16.478971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.479907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.480270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.480500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.544468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 164/349] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:16.545402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.572323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.574179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.593863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.624960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.671481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f05235-bac6-48fa-8e4f-b5fcc11eb551 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.704906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 186/350] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:16.705885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.720764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.721387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.721669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.721946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.722854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:16.723558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.725804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.733973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 165/351] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.735413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.876257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7496c0-1c52-41e6-ac1f-77a2cb78f8ba None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.891984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.911690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f350954-0251-4bb0-9a3d-34ce4bf67410 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.924650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.925297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.925570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.925835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.950967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:16.955794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:16.956716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:16.957554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 187/352] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:16.958197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.974335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.990128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.991011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.991287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.991555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.008474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:17.015284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:17.017394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 166/353] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:17.019104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.080488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510ad4-a155-47cf-9901-8c15ca540fdf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.116727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.117361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.117635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.117909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.119040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.121318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.123423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 188/354] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.124064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.145532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee877d-f883-4a8f-bc17-ed1b1f238c38 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.171667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.187280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.188368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.188887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.189350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.190284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:17.190820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.192411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7580b47-7550-4b18-b952-04b2df289ffc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.202399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 167/355] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.206080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450f45c-3c99-4a06-a935-011a41fbc79f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.206683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450f45c-3c99-4a06-a935-011a41fbc79f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.207149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450f45c-3c99-4a06-a935-011a41fbc79f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.208675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 168/356] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:17.211812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450f45c-3c99-4a06-a935-011a41fbc79f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.236074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b228b4-e8a6-48f8-90eb-2d17d18733ca None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.274686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.276925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.277844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.279068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.279619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.280682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:17.281329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.283168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29521-f9dc-4c1f-b05e-9d35a8947911 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.294603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 189/357] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.296263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.296862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.297440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.317657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:17.319311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:17.329139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450f45c-3c99-4a06-a935-011a41fbc79f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.379045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.379695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.379970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.380243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.382294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.383731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.385422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 169/358] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.386256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.403171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 190/359] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:17.407102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.443885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.535578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694b94b-649f-4ab5-8b21-bb0080ec20f9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.536218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98595793-ac74-42f0-897f-ba41692445b6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.559941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.585154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321c0bb-b4f3-4790-8313-7878be11baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.585772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321c0bb-b4f3-4790-8313-7878be11baf7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.586047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321c0bb-b4f3-4790-8313-7878be11baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.586316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321c0bb-b4f3-4790-8313-7878be11baf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.589578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.590329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.590673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.590899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] PATH_INFO: `/v3/users/d56eda00d32a4d578db04195498da387` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.592115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] RBAC: Authorizing `identity:get_user(user_id=d56eda00d32a4d578db04195498da387)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.593616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.595237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 191/360] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/users/d56eda00d32a4d578db04195498da387 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.596001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.676267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321c0bb-b4f3-4790-8313-7878be11baf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.677957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321c0bb-b4f3-4790-8313-7878be11baf7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.733766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.736172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980dcc1-d01d-4d67-a14e-896d4fe2dee3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.783931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.784875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.785157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.785729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.786520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:17.786836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.788756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.797175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 192/361] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.804713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.813041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 170/362] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:17.818101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc0c-ffb7-4b84-83dc-25c290276f4e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.821103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc0c-ffb7-4b84-83dc-25c290276f4e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.821382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc0c-ffb7-4b84-83dc-25c290276f4e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.824793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 171/363] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:17.826114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdfc0c-ffb7-4b84-83dc-25c290276f4e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.851486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.942615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011dbb4-c11c-4bce-8c66-045ab46855f4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.951132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdfc0c-ffb7-4b84-83dc-25c290276f4e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.986508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.987147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.987411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.987684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.993229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.994475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.994760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.995030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.996591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] RBAC: Adding query filter params (role.id=cfc7a3168b4e41e5bf325e24e770bedc, user.id=d56eda00d32a4d578db04195498da387, scope.system=all) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:17.996920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.998457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25229bcd-6b9e-4008-a340-bb787408dd01 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.005125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:18.010837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:18.011779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:18.012653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 193/364] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:18.013816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.017085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 172/365] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:17 2022] GET /identity/v3/role_assignments?user.id=d56eda00d32a4d578db04195498da387&scope.system=all&role.id=cfc7a3168b4e41e5bf325e24e770bedc => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.018786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.019076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.019353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.049711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:18.051203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:18.058370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.130266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 173/366] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:18.131378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.140206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.181802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c9a9-23e7-4685-bc7e-f38e571fc269 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.234982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.235789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.236167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.236620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.237807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.239300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.241469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 194/367] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.246500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.247683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61d13-c9a5-4a22-9e6b-487d0a059afa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.285924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.286765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.287167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.287597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.288388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:18.288858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.290461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.301606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 174/368] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.303350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.376817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.390118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37664-f30f-4eed-a4cb-842f0f8ec008 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.407571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.452461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79279a34-97a1-4baf-b3a5-92e242d87a01 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.454006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.454657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.454934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.456185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.478128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:18.491329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:18.492223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:18.493024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:18.495380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 195/369] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:18.496400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.509035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.509676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.509955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.510231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.512772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.514272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.516180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 175/370] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.517285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.643018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468607b-b5d1-4161-bec6-4b9a90ac9ecd None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.673993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1317-3008-484d-b262-50f457d46bca None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.694337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.694947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.695217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.695481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.720048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.720721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.721163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.721435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.725063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:18.725377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.726550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.726769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.730279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.739500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 176/371] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.740186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.796771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.798305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.869818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b126d-4b90-4378-bcae-15798caeb244 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.911498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.912331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.912439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.912744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.913466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=657e59a772544e5a86344efc58b46b9c) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:18.913761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.915282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.924589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 177/372] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.924589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.929016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 196/373] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:18.936239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.029459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.069552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.079958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eee20-1ad9-4ad1-83e0-654e154254e8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.118337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed9c7-945c-49cd-9c0e-957c93c8ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.118949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed9c7-945c-49cd-9c0e-957c93c8ea1b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.121104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed9c7-945c-49cd-9c0e-957c93c8ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.121104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed9c7-945c-49cd-9c0e-957c93c8ea1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.162413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bde1-dae6-4a91-927c-fffb39ec1b11 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.195060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed9c7-945c-49cd-9c0e-957c93c8ea1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.196678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed9c7-945c-49cd-9c0e-957c93c8ea1b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.203152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.204140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.204588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.205000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.206353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.207990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.216723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 197/374] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:19.218413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.263481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.307227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 178/375] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:19.308607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5c5f-85ed-445e-93e4-c1e752f6cf5e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.308885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5c5f-85ed-445e-93e4-c1e752f6cf5e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.309252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5c5f-85ed-445e-93e4-c1e752f6cf5e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.310658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 179/376] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:19.312337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5c5f-85ed-445e-93e4-c1e752f6cf5e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.330599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007a165-c4c5-4120-a7c8-43e79967fdd5 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.353730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.370725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0da39d-afbc-41f4-aa45-a6c823a3939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.371649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0da39d-afbc-41f4-aa45-a6c823a3939a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.372096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0da39d-afbc-41f4-aa45-a6c823a3939a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.372577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0da39d-afbc-41f4-aa45-a6c823a3939a None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.373882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0da39d-afbc-41f4-aa45-a6c823a3939a None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.375522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0da39d-afbc-41f4-aa45-a6c823a3939a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.382241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 198/377] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:19.383716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.384190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.384650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.404767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:19.406285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:19.426499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5c5f-85ed-445e-93e4-c1e752f6cf5e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.463086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.464441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.464767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.465103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] PATH_INFO: `/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.466284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab45c72f2c8847f1ab2e5e2de581c89e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.467914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.470127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 180/378] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.470977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.480312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 199/379] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:19.481554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.503120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.576814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0280-44b7-49a1-894f-98ab1ada6fc7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.592884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef32cf6-1997-4696-b078-82243fe3866d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.613118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.613592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.613762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.613998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.614261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.614971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=657e59a772544e5a86344efc58b46b9c) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:19.615455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.616715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.623029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 181/380] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.624767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.655628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.656492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.656865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.657201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] PATH_INFO: `/v3/groups/f3e64b9f0bba42dfae63d8d9260ac5ce` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.673414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] RBAC: Authorizing `identity:get_group(group_id=f3e64b9f0bba42dfae63d8d9260ac5ce)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.675135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.677219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 200/381] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/groups/f3e64b9f0bba42dfae63d8d9260ac5ce => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.683784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.741638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.750122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dde3b-4380-4ce5-82de-04f5204bb02c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.794172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.794648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.795000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.795340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.813168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:19.818604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:19.819489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:19.820458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 182/382] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:19.827218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.848304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a144-a837-406f-8511-26f62d765fae None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.898307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.898938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.899215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.899488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.900539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] RBAC: Adding query filter params (group.id=f3e64b9f0bba42dfae63d8d9260ac5ce, role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=ab45c72f2c8847f1ab2e5e2de581c89e) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:19.900886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.903689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.911607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 201/383] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/role_assignments?group.id=f3e64b9f0bba42dfae63d8d9260ac5ce&scope.project.id=ab45c72f2c8847f1ab2e5e2de581c89e&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:20.002447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f757d-6a50-41c3-a7a8-42e85e7d50fe None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.050343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.050976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.051247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.051514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.052196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:20.052500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.053986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882129-dae6-4a3b-9fa1-875643480f1a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.069231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 183/384] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:20.075616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.167755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.243335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29df65b-26f6-4214-ab4d-de4091050508 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.280298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71db91-b4cb-4f34-a174-cb9df1a2e114 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.280628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71db91-b4cb-4f34-a174-cb9df1a2e114 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.280874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71db91-b4cb-4f34-a174-cb9df1a2e114 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.282340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 184/385] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:20.289514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.289792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.290064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.305253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.305900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.306175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.306506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.307948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.309526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.311371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 202/386] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:20.317820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.322413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:20.323660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:20.348437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.458484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 185/387] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:20.478015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728460fa-7a84-46b6-a575-2432d3beb4e7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.497333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.500555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.547079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.547744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.548005 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.548275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.553429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.554882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.564927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 203/388] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:20.565796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.687703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5ce1-c21d-4b9f-9a58-b6ab04a7479c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.742392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa6b0-b0de-486c-a71b-abd1f78cd3a0 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.752134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.753220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.753560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.753893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.775797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:20.780992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:20.781923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:20.782715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:20.785046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 186/389] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:20.791353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.791498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.791498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.791498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.791732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/groups/e2577dbc3034420ebfdf980c39a48181/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.799462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] RBAC: Authorizing `identity:create_grant(project_id=90c5d2195aa940ddbaac1ea6fab6bf97, group_id=e2577dbc3034420ebfdf980c39a48181, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.805614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.806454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.832502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 204/390] 10.222.0.25 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:20 2022] PUT /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/groups/e2577dbc3034420ebfdf980c39a48181/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:20.921283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73173-8e91-4b7e-b7b9-1f4ae85f9381 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.964422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.965130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.965410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.966074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.966744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:20.967049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.968436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.977748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 187/391] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:20.985798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.038458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.108782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e2a4-790a-4779-a22f-006afd675159 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.156723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.157415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.157690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.157959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.159070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.160518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.162476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 205/392] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:21.168054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.245927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.287076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098a4c-d933-44d8-88d8-a810c35fbc3e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.328448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fea6df-2f19-4e13-968f-b5c974d3d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.329589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fea6df-2f19-4e13-968f-b5c974d3d05e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.330073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fea6df-2f19-4e13-968f-b5c974d3d05e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.330609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fea6df-2f19-4e13-968f-b5c974d3d05e None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.336341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fea6df-2f19-4e13-968f-b5c974d3d05e None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.338278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fea6df-2f19-4e13-968f-b5c974d3d05e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.340339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 188/393] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:21.346568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.488818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a6399-6dc0-48d4-aae5-f356b41b6e12 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.502089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.531437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d0b06-31d7-40ee-8ec1-9ed2ed7913f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.532113 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0b06-31d7-40ee-8ec1-9ed2ed7913f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.532371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0b06-31d7-40ee-8ec1-9ed2ed7913f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.532670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0b06-31d7-40ee-8ec1-9ed2ed7913f3 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/groups/e2577dbc3034420ebfdf980c39a48181/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.534840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d0b06-31d7-40ee-8ec1-9ed2ed7913f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=90c5d2195aa940ddbaac1ea6fab6bf97, group_id=e2577dbc3034420ebfdf980c39a48181, role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.536276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d0b06-31d7-40ee-8ec1-9ed2ed7913f3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.565522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 206/394] 10.222.0.25 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:21 2022] PUT /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97/groups/e2577dbc3034420ebfdf980c39a48181/roles/709c5429fa39482fa0cd40f9104ce17d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:21.657927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0f5e-c947-4551-a991-af04a84b4241 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.658107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0f5e-c947-4551-a991-af04a84b4241 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.658417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0f5e-c947-4551-a991-af04a84b4241 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.660004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 189/395] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:21.665737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.666029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.666300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.693793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:21.695041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:21.779479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 207/396] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:21.825424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0f5e-c947-4551-a991-af04a84b4241 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.959556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0f5e-c947-4551-a991-af04a84b4241 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.996493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.997591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.998069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.998527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.001559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.013644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:22.018483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:22.019418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:22.020749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 190/397] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:22.026157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.139105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.143350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155469f5-c6b8-4fd5-a548-969270b8f080 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.187438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.188046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.188322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.188646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.189270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:22.189569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.190964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c90c6-83c4-4432-b4f5-b5f4642e9be6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.201301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 208/398] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:22.206847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.360870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fc67-fb27-4854-b5ed-aa9f39482649 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.363815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7a27-e814-49eb-9898-153829507d59 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.364101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7a27-e814-49eb-9898-153829507d59 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.364374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7a27-e814-49eb-9898-153829507d59 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.365996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 209/399] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:22.371783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7c38f-13f7-4229-92aa-bb176f91b353 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.372061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7c38f-13f7-4229-92aa-bb176f91b353 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.372330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7c38f-13f7-4229-92aa-bb176f91b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.412888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.413894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.414374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.414845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.424395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9fb7c38f-13f7-4229-92aa-bb176f91b353 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:22.424395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9fb7c38f-13f7-4229-92aa-bb176f91b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:22.425624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.427324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.429941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 191/400] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:22.436141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.523241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.529474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 210/401] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:22.547547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392ba1-3e47-476b-b24c-c613c17fb49c None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.547547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392ba1-3e47-476b-b24c-c613c17fb49c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.547808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392ba1-3e47-476b-b24c-c613c17fb49c None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.549546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 211/402] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:22.554185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392ba1-3e47-476b-b24c-c613c17fb49c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.569031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d64f5-cce5-4294-8617-3d8dbec0cc3d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.605582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6796c9-2d5c-4a31-82e6-66f06c22334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.606607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6796c9-2d5c-4a31-82e6-66f06c22334c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6796c9-2d5c-4a31-82e6-66f06c22334c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.607799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6796c9-2d5c-4a31-82e6-66f06c22334c None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.609187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6796c9-2d5c-4a31-82e6-66f06c22334c None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.611183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6796c9-2d5c-4a31-82e6-66f06c22334c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.613104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 192/403] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:22.614606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.615095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.615580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.640459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:22.642128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:22.659102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.678269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392ba1-3e47-476b-b24c-c613c17fb49c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.718605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.719364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.719641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.719964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.721148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 193/404] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:22.722165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.738811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:22.743908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:22.744818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:22.745651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 212/405] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:22.750949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.826896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.872187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cde1cb-12f8-47f9-8e08-ce82077498a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.877738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3907-ad78-4890-ae11-69d4b5690793 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.913682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.914448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.914732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.915089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c/groups/e2577dbc3034420ebfdf980c39a48181/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.916676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.917807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=657e59a772544e5a86344efc58b46b9c, group_id=e2577dbc3034420ebfdf980c39a48181, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.918406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.918837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.919239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.919345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.920117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:22.920550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.922067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.933263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 213/406] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:22.934571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.936815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 194/407] 10.222.0.25 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:22 2022] PUT /identity/v3/projects/657e59a772544e5a86344efc58b46b9c/groups/e2577dbc3034420ebfdf980c39a48181/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:22.939317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.954500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.060605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0fb5-1396-40a1-85d9-1449173679e8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.071996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ac85-2bd1-4d8a-b348-49382f5d0153 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.083739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.098025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.098976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.099107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.105070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] PATH_INFO: `/v3/groups/f3e64b9f0bba42dfae63d8d9260ac5ce` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.105070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] RBAC: Authorizing `identity:get_group(group_id=f3e64b9f0bba42dfae63d8d9260ac5ce)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.105070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.106421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 195/408] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/groups/f3e64b9f0bba42dfae63d8d9260ac5ce => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.112128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.145354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.146568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.147063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.147566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.185367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:23.191008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:23.191881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:23.192689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:23.194985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 214/409] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:23.200972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.229411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930936-029c-4bc1-a7dd-828f130bc8b6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.271404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.272469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.274099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.274099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] PATH_INFO: `/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.275691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] RBAC: Authorizing `identity:get_project(project_id=ab45c72f2c8847f1ab2e5e2de581c89e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.278085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.281034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 196/410] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:23.287781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.332808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.366661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e2a9-88d3-4eb0-b1bb-e67c23dc61a0 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.417126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.425269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.427332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb36a8-6df2-4765-8794-7dffc5680802 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.428177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.428712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.429187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.431567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:23.432092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.434532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.454506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 215/411] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.460291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.488034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.489111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.490579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.491079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] PATH_INFO: `/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e/groups/f3e64b9f0bba42dfae63d8d9260ac5ce/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.495620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] RBAC: Authorizing `identity:create_grant(project_id=ab45c72f2c8847f1ab2e5e2de581c89e, group_id=f3e64b9f0bba42dfae63d8d9260ac5ce, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.498810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.521827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 197/412] 10.222.0.25 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:23 2022] PUT /identity/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e/groups/f3e64b9f0bba42dfae63d8d9260ac5ce/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:23.605838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd7cd-1fd2-48b2-bc1e-659352109e15 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.652306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.653415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.653916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.654403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.655781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.657478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.659612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 216/413] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.665100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.803496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692a89-52e5-49f4-a130-3cb389834b4b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.829626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.856499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb5ab3-cff5-489d-b3de-a0ed843c8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.857173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb5ab3-cff5-489d-b3de-a0ed843c8812 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.857445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb5ab3-cff5-489d-b3de-a0ed843c8812 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.857711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb5ab3-cff5-489d-b3de-a0ed843c8812 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.858882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb5ab3-cff5-489d-b3de-a0ed843c8812 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.860356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb5ab3-cff5-489d-b3de-a0ed843c8812 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.866767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 198/414] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.870709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.884504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.889615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a9b2-d8cb-4528-87d9-d0d9a80496bf None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.890150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a9b2-d8cb-4528-87d9-d0d9a80496bf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.890611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a9b2-d8cb-4528-87d9-d0d9a80496bf None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.892275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 199/415] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:23.897775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.898055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.898328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.917414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:23.918616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:24.005709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d982f0-db12-4832-bd7f-4d72f200270d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.046378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.047530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.048012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.048486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c/groups/e2577dbc3034420ebfdf980c39a48181/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.051067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] RBAC: Authorizing `identity:create_grant(project_id=657e59a772544e5a86344efc58b46b9c, group_id=e2577dbc3034420ebfdf980c39a48181, role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:24.052868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:24.068629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 200/416] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:24.086960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 217/417] 10.222.0.25 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:23 2022] PUT /identity/v3/projects/657e59a772544e5a86344efc58b46b9c/groups/e2577dbc3034420ebfdf980c39a48181/roles/709c5429fa39482fa0cd40f9104ce17d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:24.090529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.206119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a43d0-7ced-438f-94eb-a3a36b529a0f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.225212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:24.247337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.249107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.249578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.250051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.262612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:24.267944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:24.268845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:24.269739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:24.272455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 201/418] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:24.279103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.365064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:24.405607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61bbb-5c36-4ac8-b206-15eb2b96ccfc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.441465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.442070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.442349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.442615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.443272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] RBAC: Adding query filter params (name=member) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:24.443621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:24.445017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107761a3-6c9f-4e14-a5ac-0184513b9425 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:24.454387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 218/419] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:24.459965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.473609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c870ab-60c7-4ce7-a034-7fb30b7457e6 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.473929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c870ab-60c7-4ce7-a034-7fb30b7457e6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.474167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c870ab-60c7-4ce7-a034-7fb30b7457e6 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.475654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 219/420] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:24.481289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.481576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.481852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.509994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:24.514343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:24.632822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 220/421] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:24.648383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767731c-1dc8-44d4-a0d1-84268a46b151 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.652585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.713364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:24.721311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.722274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.722581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.722946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.764368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324793d3-68fe-4477-9956-88fcd5c2d16a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.803492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.804430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.804968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.805416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.817198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:24.822398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:24.823409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:24.824198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:24.830514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 221/422] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:24.833147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.835152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:24.910679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:24.912181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:24.956226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae862e-9cb0-4481-b1e4-521fb967cff7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.976244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.000429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.001357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.002683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.003143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.004022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:25.004514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.006176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.022261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 222/423] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:25.025117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.142940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b445b-558f-4baf-b6db-5161034fff85 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.183218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.184165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.184909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.185361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.195612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 202/424] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:25.201477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.267329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.269003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.282282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.388827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.432145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a62d2-2033-43a5-8799-533b0aaaaa74 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.440469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 223/425] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:25.444674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.512233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.512921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.513193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.513461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.516359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.517838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.529318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 203/426] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:25.540758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.656180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85024a-8559-4dd3-81b6-a2a98f06f4be None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.668923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.709051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda99038-14df-4a74-9265-7d4193c838d5 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.719383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634f656-d843-4238-b965-eaff90ad5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.720392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f656-d843-4238-b965-eaff90ad5dbb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.720877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f656-d843-4238-b965-eaff90ad5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.721425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634f656-d843-4238-b965-eaff90ad5dbb None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.722712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f656-d843-4238-b965-eaff90ad5dbb None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.724439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634f656-d843-4238-b965-eaff90ad5dbb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.726747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 204/427] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:25.728100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db729bb-dba4-4185-b4a4-771186a98c32 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.728699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db729bb-dba4-4185-b4a4-771186a98c32 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.729151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db729bb-dba4-4185-b4a4-771186a98c32 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.735095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 205/428] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:25.736945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.737426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.737875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.752639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.753275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.753551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.753820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] PATH_INFO: `/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.755237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] RBAC: Authorizing `identity:get_project(project_id=90c5d2195aa940ddbaac1ea6fab6bf97)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.756698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.758449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:25.763535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 224/429] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/projects/90c5d2195aa940ddbaac1ea6fab6bf97 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:25.763535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.765172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:25.773597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.852035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 206/430] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:25.853569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.887472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ffd5-5880-4d4d-853a-1359dbe23896 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.928031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.928672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.928929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.929193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.929910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:25.930208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.931627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897be5e-283a-4da4-816d-f1c6ffb4df95 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.940748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 225/431] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:25.940748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f27ad4-125d-4834-938e-c5bf05b304b2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.940748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f27ad4-125d-4834-938e-c5bf05b304b2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.940748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f27ad4-125d-4834-938e-c5bf05b304b2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.941987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 226/432] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:25.942550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f27ad4-125d-4834-938e-c5bf05b304b2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.957776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.003457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f695d08-cae2-4046-b7c7-688ca8bb2ce3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.042884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796200c-9174-4053-b7b5-6bf7c4c0ff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.043743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796200c-9174-4053-b7b5-6bf7c4c0ff2d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.044110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796200c-9174-4053-b7b5-6bf7c4c0ff2d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.044479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796200c-9174-4053-b7b5-6bf7c4c0ff2d None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.045811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796200c-9174-4053-b7b5-6bf7c4c0ff2d None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.047371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796200c-9174-4053-b7b5-6bf7c4c0ff2d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.049506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 207/433] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:26.050903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.051274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.051638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.071640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:26.073121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:26.077331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.097698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f27ad4-125d-4834-938e-c5bf05b304b2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.153018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.153959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.154420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.154523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 208/434] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:26.154956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.155545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.168790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:26.177163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:26.178085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:26.178901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:26.181875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 227/435] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:26.183379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.277009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.290288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ad670-1378-49d1-8610-cd91ace315d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.321737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353cea-63df-4e37-93dc-015b52457322 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.334745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.335362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.335639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.336365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.337139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:26.337454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.339633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.346089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 209/436] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=90c5d2195aa940ddbaac1ea6fab6bf97&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:26.347154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.350733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.375048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.375705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.375983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.376256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.394396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:26.399943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:26.401288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:26.402119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:26.404626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 228/437] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:26.411023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.500534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b77582-54db-4da7-8f82-d555c6dc22e2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.550558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.550756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.550987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.551261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.551364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b0c3-3594-401f-9258-7e901d8b1575 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.551921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:26.552223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.553747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2b81-fc82-42bb-9db4-70a2b861f275 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.565539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 210/438] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:26.566780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a592b9-b21d-4c9f-8cc0-e93ef7c33c33 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.567060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a592b9-b21d-4c9f-8cc0-e93ef7c33c33 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.567413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a592b9-b21d-4c9f-8cc0-e93ef7c33c33 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.568516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 211/439] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:26.573981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a592b9-b21d-4c9f-8cc0-e93ef7c33c33 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.586458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.594797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.595509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.595851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.596189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.596950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:26.597249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.598609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2d08-70c2-460b-8f14-d1f7522a4ebc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.609804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 229/440] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:26.611177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.611458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.611729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.631019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:26.633210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:26.653757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.699220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a592b9-b21d-4c9f-8cc0-e93ef7c33c33 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.710354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 230/441] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:26.711112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.736116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.736839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.737114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.737321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.818856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.820230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.823874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d868bb-fc78-4b4e-9bd4-ebcc50d8ad43 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.846673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.859260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.859850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.860122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.860390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.882850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.919099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 212/442] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:26.919925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.930596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.932059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.019108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f48f3-aa68-43f3-ac1b-b2632c4fce82 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.030132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 231/443] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:27.030966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.053985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.058202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.058896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.059166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.059432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.069298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:27.074631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:27.075524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:27.076300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 213/444] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:27.077007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.103277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.134266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb84f0-9762-49ee-95a4-1dca4b42428c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.169312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.169593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.169869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.170144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.171244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.172713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.178845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 232/445] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.178845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.180653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab23b-ec57-4b81-bd78-900b35ea4382 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.215548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.216171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.216450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.216807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] PATH_INFO: `/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.217909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] RBAC: Authorizing `identity:get_project(project_id=ab45c72f2c8847f1ab2e5e2de581c89e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.219351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.221004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 214/446] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/projects/ab45c72f2c8847f1ab2e5e2de581c89e => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.221762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.269069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.279907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680e9f-433a-4ef4-91fa-7d4afdc3bd85 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.312372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.312988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.313259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.313524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.314173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:27.314461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.315817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.317004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.324507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 233/447] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.324990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fd0c7-8f4f-4ebf-a709-c8eaa5bfc565 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.325248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.361701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.362330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.362609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.362879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.363977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.365457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.366997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 215/448] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.367743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.429181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfdcb5-c33c-4eb6-8462-f329841f34ab None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.461966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.462574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.462844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.463109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] PATH_INFO: `/v3/groups/f3e64b9f0bba42dfae63d8d9260ac5ce` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.464301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] RBAC: Authorizing `identity:get_group(group_id=f3e64b9f0bba42dfae63d8d9260ac5ce)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.465750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.466075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08457-2c94-4fd7-8692-b56d69815818 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.467449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 234/449] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/groups/f3e64b9f0bba42dfae63d8d9260ac5ce => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.468111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.490200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.505551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.506146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.506418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.506683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.536822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.567529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedd684-c205-4f97-8bfc-28d98200246d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.575433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.576853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.601295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.601884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.602159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.602429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.603141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=7969717fb22c46249a430b8bd7e844c4, scope.project.id=657e59a772544e5a86344efc58b46b9c) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:27.603445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.605088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.610877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 235/450] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=7969717fb22c46249a430b8bd7e844c4 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.611474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.704871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 216/451] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:27.710661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.723776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.745546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70bbd0-84db-4ac4-bde8-d74a5569da0d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.785360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.791839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.792626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.792826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.793153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.793880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] RBAC: Adding query filter params (group.id=f3e64b9f0bba42dfae63d8d9260ac5ce, role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=ab45c72f2c8847f1ab2e5e2de581c89e) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:27.794185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.795613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.802012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 236/452] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/role_assignments?group.id=f3e64b9f0bba42dfae63d8d9260ac5ce&scope.project.id=ab45c72f2c8847f1ab2e5e2de581c89e&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.840842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465a49-db88-4231-bb89-34bfede0c111 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.880274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.883287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.883287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.883287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] PATH_INFO: `/v3/projects/657e59a772544e5a86344efc58b46b9c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.883287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=657e59a772544e5a86344efc58b46b9c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.884158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.886449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 217/453] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/projects/657e59a772544e5a86344efc58b46b9c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:27.891983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.016515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866521-2e28-469c-b528-5b661c01ab4a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.050976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a0247-f9fd-44a7-8109-b8f3061229ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.051599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0247-f9fd-44a7-8109-b8f3061229ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.051878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0247-f9fd-44a7-8109-b8f3061229ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.052158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0247-f9fd-44a7-8109-b8f3061229ee None admin] PATH_INFO: `/v3/groups/e2577dbc3034420ebfdf980c39a48181` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.053282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a0247-f9fd-44a7-8109-b8f3061229ee None admin] RBAC: Authorizing `identity:get_group(group_id=e2577dbc3034420ebfdf980c39a48181)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:28.054714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a0247-f9fd-44a7-8109-b8f3061229ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:28.056279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 237/454] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/groups/e2577dbc3034420ebfdf980c39a48181 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:28.062284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.159880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d6fee-ec91-4301-8d85-331f56875ca5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.187387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:28.193449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.194044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.194321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.194593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.195304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] RBAC: Adding query filter params (group.id=e2577dbc3034420ebfdf980c39a48181, role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=657e59a772544e5a86344efc58b46b9c) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:28.195609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:28.197075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e8349-f2b7-4682-8f94-ac7bea219818 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:28.203258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 218/455] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/role_assignments?group.id=e2577dbc3034420ebfdf980c39a48181&scope.project.id=657e59a772544e5a86344efc58b46b9c&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:30.931962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8588-4724-4d75-b044-786657036917 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:30.933853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8588-4724-4d75-b044-786657036917 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:30.934337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8588-4724-4d75-b044-786657036917 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:30.936106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 238/456] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:30.941679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:30.942497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:30.943009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:30.968688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:30.970194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:31.041614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d184c9-05db-47cb-a6fc-a7320699b9f5 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.042754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d184c9-05db-47cb-a6fc-a7320699b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.043299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d184c9-05db-47cb-a6fc-a7320699b9f5 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.045101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 239/457] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:31.050299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60f19-610e-469f-a031-d08f240a4530 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.050798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60f19-610e-469f-a031-d08f240a4530 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.051258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60f19-610e-469f-a031-d08f240a4530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.067876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 219/458] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:31.070041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-30b60f19-610e-469f-a031-d08f240a4530 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:31.071437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-30b60f19-610e-469f-a031-d08f240a4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:31.094686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.096381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.172883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 240/459] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:31.172883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f9de-0cfc-4b6f-aeb8-2fcc568c7308 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.172883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f9de-0cfc-4b6f-aeb8-2fcc568c7308 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.172883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f9de-0cfc-4b6f-aeb8-2fcc568c7308 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.176588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 241/460] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:31.180355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f89da-a423-46cb-8665-537fb9536481 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.180659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f89da-a423-46cb-8665-537fb9536481 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.180930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f89da-a423-46cb-8665-537fb9536481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.207414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-938f89da-a423-46cb-8665-537fb9536481 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:31.208685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-938f89da-a423-46cb-8665-537fb9536481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:31.222893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f435a16-28bf-4dbd-b540-15def689f3c7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.249866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.263700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.264332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.264632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.264907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.275821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.277612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.292712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 242/461] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:31.293505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:31.294494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:31.295324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:31.295324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:31.295324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:31.295501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f89da-a423-46cb-8665-537fb9536481 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.297430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 220/462] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:31.303177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.399832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.425946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f89da-a423-46cb-8665-537fb9536481 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.450054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7953d2-720b-4255-966b-1da73811f39c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.468906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.470275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.470749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.471209 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.486153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.487916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.488067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.489007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.489448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.489956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.490970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:31.491476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.493077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:31.506562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:31.507492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:31.509218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:31.509218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:31.509218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:31.509218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 243/463] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:31.510693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 221/464] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:31.510795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.516499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.556433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.626312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4db243-d631-45d6-b768-894bc4b0fb16 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.630974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38ec0-be55-431b-8d7c-d4dcf53dbfd5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.654907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.663367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.664420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.664955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.665418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.672451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.673218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.673897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.674013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.674757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:31.675156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.676758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.678096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.679858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.691053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 222/465] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:31.692066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:31.695921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:31.696836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:31.697669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:31.697669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:31.697669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:31.699769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 244/466] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:31.701791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.800612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.809734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fdfcd-cf16-463d-98b6-9ae95bbfa5b4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.812890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17671d-710a-42cd-b26a-dd09b0581719 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.847722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.848337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.848645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.848918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.849554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.850440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098d608-349c-458c-a5a9-c5fdfea3caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.851006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.851108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098d608-349c-458c-a5a9-c5fdfea3caa9 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.851323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098d608-349c-458c-a5a9-c5fdfea3caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.851596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098d608-349c-458c-a5a9-c5fdfea3caa9 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.852227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098d608-349c-458c-a5a9-c5fdfea3caa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:31.853700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098d608-349c-458c-a5a9-c5fdfea3caa9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:31.871715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 223/467] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:31.872604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.875130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 245/468] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:31.876552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae1d4b-4b53-47b5-8c0c-0c3fd56e22ce None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.876865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae1d4b-4b53-47b5-8c0c-0c3fd56e22ce None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.877143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae1d4b-4b53-47b5-8c0c-0c3fd56e22ce None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.878646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 246/469] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:31.882113 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2fd8-58fd-4f70-909b-ceeba51c011d None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.883282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2fd8-58fd-4f70-909b-ceeba51c011d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.883569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2fd8-58fd-4f70-909b-ceeba51c011d None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.886458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 247/470] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:31.888342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a962-062d-4b0f-abae-e6f865120699 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.888832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a962-062d-4b0f-abae-e6f865120699 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.889273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a962-062d-4b0f-abae-e6f865120699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.915962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8c97a962-062d-4b0f-abae-e6f865120699 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:31.919146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8c97a962-062d-4b0f-abae-e6f865120699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:31.974923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.007373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368741-110f-4e6d-930b-b3d6a30a84ed None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.034577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 248/471] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:32.036677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.037193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.037652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.059095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:32.060221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.060419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:32.060839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.061119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.061391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.062041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:32.062347 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.063997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.086381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 224/472] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:32.087056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.106086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.151513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 249/473] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:32.152504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.233879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f0b3-6368-4ea9-946b-a1096b7e5513 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.274129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.274760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.275036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.275308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.281451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.288353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d115a3-f290-4091-a5fe-709dc9310478 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.290426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.292641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:32.309718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:32.310702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:32.311765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:32.311765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:32.311765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.311765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 225/474] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:32.312155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.331919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.332770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.333432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.333709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.334351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.335793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.371876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 250/475] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:32 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:32.373030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.392276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.473664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5cf6c-8635-4e51-b975-c8f00fedb2b3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.520617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.521773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.522095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.522377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.523061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.525198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.536001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.sql.core [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 18:07:32.536001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 18:07:32.536001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [parameters: {'id': '30e9080d6958496ab64a75d77b9507ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 18:07:32.536001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 18:07:32.540757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4317009-ff2d-4e0a-91d2-01d4b3b6ca2d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Aug 07 18:07:32.557193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:07:32.558155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application yield resource Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise self.value Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application session.commit() Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 18:07:32.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.flush() Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application compat.raise_( Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 18:07:32.560786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:07:32.561655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:07:32.562457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [parameters: {'id': '30e9080d6958496ab64a75d77b9507ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:32.565985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 18:07:32.567885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.577919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 226/476] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Aug 7 18:07:32 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:32.577919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.600449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.601448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.601865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.602264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.602921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:32.603389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.605850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.622158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 251/477] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:32.628311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.647518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.697056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7536-c448-4560-a7b6-749492f5f5bb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.730094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.740780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.741433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.741712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.741987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.759579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:32.762184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07ddf6-d14c-4874-8f0a-117ce1ae7e8f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:32.766218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:32.768209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:32.771371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:32.773128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 227/478] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:32.778410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.813623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a819-0b84-41b7-8b4c-0f042da0070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.814622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a819-0b84-41b7-8b4c-0f042da0070e None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.814905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a819-0b84-41b7-8b4c-0f042da0070e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.815176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a819-0b84-41b7-8b4c-0f042da0070e None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.815823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a819-0b84-41b7-8b4c-0f042da0070e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.817299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a819-0b84-41b7-8b4c-0f042da0070e None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.851033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 252/479] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:32 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:07:32.950697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ba9f-fc09-4240-96cf-de10a5fb1c01 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.989106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.989803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.990079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.990393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.991051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:32.991351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.992772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0be9-22f7-4b05-8d4b-5a33038a8010 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.002815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 228/480] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:34.280184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160d8e5-0beb-4b9d-b2c4-93b8337e9c8e None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.280728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160d8e5-0beb-4b9d-b2c4-93b8337e9c8e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.280827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160d8e5-0beb-4b9d-b2c4-93b8337e9c8e None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.283466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 253/481] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:34.287625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.288028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.288215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.310805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:34.312014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:34.358280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d840-a89d-44b4-8c97-f5f9f69265f6 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.358580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d840-a89d-44b4-8c97-f5f9f69265f6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.358831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d840-a89d-44b4-8c97-f5f9f69265f6 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.360727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 254/482] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:34.365851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.366130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.366405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.376310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.397771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:34.399032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:34.399231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 229/483] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:34.457890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.480272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.495332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 255/484] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:34.529234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.576766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e81d-8888-4f33-949d-18da6faf1d05 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.613364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.614087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.614373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.614643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.626084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:34.630959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:34.631854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:34.632671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 230/485] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:34.641507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.683767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0723a-3fff-4201-8599-57ebaa52d075 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.729896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.734055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.734885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.735163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.735458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.757318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:34.762799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:34.764858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:34.766716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 256/486] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:34.777752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.811536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b8fb9-314a-463b-9e8f-98ec2c82c0a1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.849325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.849857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.850134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.850405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.851492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:34.851799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.853226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.863858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 231/487] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.871074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.904973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.938482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3185-b309-4539-b2bb-bb63fad8bb7a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.978104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.978818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.979642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.980045 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.980968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] RBAC: Adding query filter params (name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:34.981276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.982652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.991679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 257/488] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.997353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.108719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ad11-fa4f-44e5-bd33-40b70e507161 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.110339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.156385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff262a-895f-4701-a139-0bdac525a441 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.177993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.193649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.194291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.194569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.194844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.198760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.199378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.199656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.199928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.219434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.221573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.223053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.223674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e19d1f29-fb19-4abe-ba6c-7e9230dc7304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:35.247272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:35.248197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:35.249060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:35.249060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:35.249060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:35.249229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:35.249999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:35.250842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:35.250842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:35.250842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:35.250996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 258/489] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:35.251059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 232/490] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:35.251122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc67a-9df0-4f12-a62d-06cda4969541 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.251122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc67a-9df0-4f12-a62d-06cda4969541 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.251122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc67a-9df0-4f12-a62d-06cda4969541 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.254651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.255160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 259/491] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:35.257604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.257885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.258153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.278599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:35.279786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:35.360805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 260/492] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:35.361664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.381301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16667f-006b-438d-a0f9-647d378edc28 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.422616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.423625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.424111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.424641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.425520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.426012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.427622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.441204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 233/493] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.442396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.458870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.486419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec173e-4180-4522-bc27-a39d6b116256 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.487937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.532155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.533311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.533729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.534295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.535352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.535807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.537329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0e4ea-f5eb-4ea5-a1f3-49589f55c9f9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.549699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366a7b-f2f9-494f-905f-7bca313b85a6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.557640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 261/494] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.557640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8991ef-d8e4-48a0-b960-7f6580dbbb8e None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.557640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8991ef-d8e4-48a0-b960-7f6580dbbb8e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.557640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8991ef-d8e4-48a0-b960-7f6580dbbb8e None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.557640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 262/495] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:35.557640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8991ef-d8e4-48a0-b960-7f6580dbbb8e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.587280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.587906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.588177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.588541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.600652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:35.605420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:35.606303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:35.607095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 234/496] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:35.607765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.672729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8991ef-d8e4-48a0-b960-7f6580dbbb8e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.689028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.707845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.708464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.708767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.709037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.715672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7385d-2c0f-4303-b49f-fde62bba67ef None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.717252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.718679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-217673ef-933d-4c68-92c6-8456fb3f6a4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:35.731282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:35.732319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:35.733466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 263/497] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:35.734024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57deff3-37b0-4ae0-85c0-1cfc7b024a23 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.734024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57deff3-37b0-4ae0-85c0-1cfc7b024a23 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.734255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57deff3-37b0-4ae0-85c0-1cfc7b024a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.751957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d57deff3-37b0-4ae0-85c0-1cfc7b024a23 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:35.753153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d57deff3-37b0-4ae0-85c0-1cfc7b024a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:35.755510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.756136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.756411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.756715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.763980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.765443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.769579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:35.778985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:35.779897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:35.780813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 235/498] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:35.781386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.825242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 264/499] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:35.826502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef581-4c7b-4db3-a133-7a905ba3b041 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.826783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef581-4c7b-4db3-a133-7a905ba3b041 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.827046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef581-4c7b-4db3-a133-7a905ba3b041 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.828486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 265/500] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:35.828979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ef581-4c7b-4db3-a133-7a905ba3b041 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.888450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd53b-e0d3-41e9-867f-1b6ee562a1d5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.921894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.922724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.923050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.923276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.923934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.924235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.925633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.926921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.930839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ef581-4c7b-4db3-a133-7a905ba3b041 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.934978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 236/501] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.935771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.966152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.966752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.967028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.967301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.968016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.968320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.969782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884adb-733f-48d6-8d95-8b3a142544d7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.005825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 266/502] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.007026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.007306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.007577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.024408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:36.026403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:36.029618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.042213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950b6f-6b17-4f39-965b-617544968dac None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.075622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.076220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.076498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.076803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.077529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:36.077837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.079267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.092337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 267/503] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:36.093211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.116107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 237/504] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.116988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.171527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.191931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d6c1c-37ab-4e83-8880-895bc0a54533 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.215936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463b6f8-d5e5-4e19-bf28-7fe062e3d536 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.225183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.225805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.226081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.226350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.234430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.237574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:36.242525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:36.243396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:36.244185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 268/505] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:36.245480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.254146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.254774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.255053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.255329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.265981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.267419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:36.281962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:36.283032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:36.283916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:36.283916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:36.283916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:36.283916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 238/506] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:36.284136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.346734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca7ed-0fe6-44b9-8004-3fb3205ada0c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.381264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.381918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.382128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.382405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.386082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462270b0-8884-452f-8435-94d39759dcb1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.392759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.420033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.420697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.420977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.421252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.431426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.432951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:36.446990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:36.448472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:36.449813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:36.449813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:36.449813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:36.449813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 239/507] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:36.450342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.458822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.461341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.463054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.549951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841194-80cf-453c-bb97-bd8f21d1da39 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.571100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 269/508] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:36.571945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.588250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.589140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.589311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.589584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.616208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.657667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.659160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.667536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.670422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a00ce3-cd89-488b-a7ec-00eaee676884 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.704613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.705132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.705404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.705672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.706322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:36.706619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.707961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.716349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 270/509] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.717157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.760274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 240/510] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:36.761678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.815545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246afdf-fc36-47dd-b631-48a8dca1cd35 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.823758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.848468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.849103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.849386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.849661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.850296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:36.850600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.851993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.863687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 271/511] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.863918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8285fd-fe9b-4903-9bba-44f00b05a995 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.864475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.891880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.899868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.900741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.901101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.901372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.902001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:36.902298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.903661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.914612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 241/512] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.915236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.968650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66348d-9ae8-43f6-8bf8-087f13c6e1d4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.003412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.004047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.004306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.004593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.013029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17960f0-e2ab-4e55-b7c0-f65ca14e8ef1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.014534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.015995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.030329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:37.030562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.031494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:37.032373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:37.032373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:37.032373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:37.032373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 272/513] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.033398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.052020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.052606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.052882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.053152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.064356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.065826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:37.079999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.081147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:37.081979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:37.081979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:37.081979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:37.081979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 242/514] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.081979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.117766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.141927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea749-cd5d-4071-89bb-2bd97080a319 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.175843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.176462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.176759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.177027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.179878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232731d6-f467-466a-abbf-e0386c7e7888 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.188127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.189609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:37.203661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.204743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:37.205600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:37.205600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:37.205600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:37.205600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 273/515] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.205809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.217334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.217968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.218243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.218525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.225977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.227356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:37.238794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.239851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 243/516] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.241172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.270623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.309775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe821dd-def1-471c-8d8d-7a3b904620b0 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.335222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.340676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851375-783f-4767-bdfa-9539a919e83e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.344971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.345727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.346015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.346318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.346969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.348382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.380544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 274/517] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:37 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:37.380544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.380853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.380853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.380853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.380853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.381204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:37.381204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.381204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.394705 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 244/518] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.396326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.499533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30779-30b8-4217-bbd5-ab78d6df4759 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.502113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.514123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bd4f-7e73-461e-9ca9-8d18425fa03a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.539750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.540359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.540665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.540942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.541660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:37.542068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.543439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.555966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.556305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.556600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.556697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 275/519] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.558171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.558330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.558468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:37.558468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.559833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.574398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 245/520] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.575831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.611340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.671722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615743db-cd0b-430e-bd31-f7bb172a7e45 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.687778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a21e-1fed-42fd-b6b2-a7a0d1fe3de2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.707404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.708009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.708284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.708554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.709305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:37.709605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.711038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.726048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.726677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.726959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.727224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.734614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 276/521] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.734614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.740371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.741852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:37.754598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.755465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:37.756308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:37.760180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 246/522] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.761577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.774257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.847562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.850519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ded6c-f0fa-4cae-8827-a0ee4c30cac8 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.880604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65cb63-c1db-40c5-a7b5-a6fe6ae784d7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.891688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.892305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.892915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.893190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.900398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.902308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:37.914278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.915160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:37.916031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 277/523] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.917920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.920175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.920994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.921115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.921352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.929058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.930998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:37.943852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:37.945029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:37.945863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 247/524] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:37.949492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.022218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.031635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b90b92-9e77-4bb9-bf15-f3ee006db92a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.054836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4079b3-9f37-4efc-a02a-910e69351efc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.072152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.073081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.073361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.073819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.092369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe40c-380d-480a-a244-38370408d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.093388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe40c-380d-480a-a244-38370408d300 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.093848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe40c-380d-480a-a244-38370408d300 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.094299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe40c-380d-480a-a244-38370408d300 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.095165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe40c-380d-480a-a244-38370408d300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:38.095651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe40c-380d-480a-a244-38370408d300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.097301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe40c-380d-480a-a244-38370408d300 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.103599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.121671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 248/525] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:38.121671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe40c-380d-480a-a244-38370408d300 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.151597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.153286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.224846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe40c-380d-480a-a244-38370408d300 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.257092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.260089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 278/526] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:38.261463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.272214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.273215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.273619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.273892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.274620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:38.274921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.277150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.300127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 249/527] 10.222.0.25 () {56 vars in 1139 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:38.300127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.328850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.375427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6883-cd56-4c04-83ab-fb2f3fa23c11 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.410514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648958-0958-427b-8ceb-6131e3976048 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.412668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.413583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.413583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.413983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.414680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:38.414980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.416399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.440203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 279/528] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:38.440203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.453211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.453824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.454099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.454369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.455084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=d8ab184b2ae0437d9fb01eac225baf06) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:38.455388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.456843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.462287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 250/529] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/role_assignments?user.id=d8ab184b2ae0437d9fb01eac225baf06&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:38.463071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.534653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.569117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae13fb-c02a-459a-9764-8db93bb2f8ee None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.583853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae5a7-8729-4858-8e69-31a90fb26437 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.593019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.611051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.611867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.612241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.612643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.625277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.627199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.629065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.629995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.630584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.630865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:38.644385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:38.645394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:38.646217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:38.646217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:38.646217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:38.646217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 280/530] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:38.646942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.721251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.722899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.770129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0267-559c-46d6-aa1d-47cf92382bd2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.787166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.817285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.817893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.818648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.818927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.819661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=099e4db05ff34c9bad67022f4484c108) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:38.820396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.822168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.830718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 281/531] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/role_assignments?user.id=099e4db05ff34c9bad67022f4484c108&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:38.832103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.846388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 251/532] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:38.851848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.886906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.981808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42db0b-9d09-4358-bcb0-efd8ceb58e4f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.022647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf35d76-8b79-4b98-aa7f-62d370b3a295 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.035357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.036018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.036301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.036585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.058637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.060065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:39.087545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:39.090285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:39.092312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:39.092312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:39.092312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:39.092312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 252/533] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:39.097877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.097877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.097877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.097877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.098519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.098519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.099232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.102346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.113303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 282/534] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:39.115210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.119041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.220239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2c77a-4007-4ab8-982c-4391593235dc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.257061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.257679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.258027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.258305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.258950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.259316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.261295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.272250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.274821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 253/535] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:39.283117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.284430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3f17-de09-45b0-840c-4292d2fa2a82 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.357777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.373083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.373718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.374001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.374271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.393651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.395119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.400396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b913c-d2ee-482b-b593-02b671637e26 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:39.419790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:39.420691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:39.421512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:39.429363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 283/536] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:39.437709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.438284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.438466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.438682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.438960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.446769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.448630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:39.462297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:39.464321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:39.465317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 254/537] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:39.471661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.592552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad30060-184a-4854-ae0b-103913ec9b2e None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.598769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3583c-8f22-4d6e-9f55-883454302712 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.626705 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.643321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.643910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.644082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.644423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.644605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.644806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.644958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.645086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.645695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.645854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.646027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.646167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.647524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfd291-2506-42d2-aa83-3aa7b18160b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.647686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.663518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 255/538] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:39.664774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054018b6-2b21-4f9a-a746-be0c3ed75061 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.665057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054018b6-2b21-4f9a-a746-be0c3ed75061 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.665335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054018b6-2b21-4f9a-a746-be0c3ed75061 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.666564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 256/539] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:39.673290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 284/540] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:39.674011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.674204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.674360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.674692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.698918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.699894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:39.701882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:39.796670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 257/541] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:39.797657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.822178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e4a8-e009-4de2-81d5-6e43607d9c78 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.869742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.870720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.871052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.871717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.872443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=15c36ce12e5b4f25848137a9dc590f55) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.872797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.874833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.883112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 285/542] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/role_assignments?user.id=15c36ce12e5b4f25848137a9dc590f55&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:39.883858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.964600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42e90-2308-47ca-839e-3bc8db48f7ac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.981521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.004911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.005625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.005901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.006170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.006896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=9ab6c2c2f06040d09952c23e76d2c8b6) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:40.007202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.008686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.015927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 258/543] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/role_assignments?user.id=9ab6c2c2f06040d09952c23e76d2c8b6&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:40.086312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.110396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bde7-2940-42d3-93ff-5901f34c5afb None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.148728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.149264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.149537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.149802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.162643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:40.168624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:40.169549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:40.170329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:40.173088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 286/544] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:40.177777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.293303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802632c-d29c-499d-88e6-009b1c1867c6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.329171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.329778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.330054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.330325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.330985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:40.331284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.332674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.341954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 259/545] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:40.347760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.484056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ef928-f1b1-4538-8566-e62be21f46cc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.519010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.519978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.520449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.520933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.531398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.533950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.535803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:40.551482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:40.552394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:40.553237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:40.553237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:40.553237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:40.555267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 287/546] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:40.560742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.638987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.721366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158ea2-f598-4e39-9b0e-f34184379911 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.773231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.773759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.774040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.774313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.775002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:40.775303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.777156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f006fe0-f953-4146-8a4f-2ead8488d8f0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.796877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 260/547] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:40.802450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.840409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ece0-e90c-44f9-82d2-58ce88d7eef7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.840768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ece0-e90c-44f9-82d2-58ce88d7eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.841003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ece0-e90c-44f9-82d2-58ce88d7eef7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.842571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 261/548] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:40.852592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.852592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.852592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.877898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:40.879096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:40.986063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94140c7e-37bc-4572-aba5-7a535db754d9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.004224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 262/549] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:41.027329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.060389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.061039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.061315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.061584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.072506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.075184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.092908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:41.100501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:41.101901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:41.102963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 288/550] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:41.117597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.201524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204476-80e7-44f2-9db4-8637bb28913b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.218724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.270740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d118b-94c3-4a2c-b398-b46a98a6a427 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.273315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.273986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.274287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.274564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.305538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:41.306751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.307889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.308160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.308431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.309168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:41.309469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.310904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:41.311220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:41.313216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:41.315280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 263/551] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:41.320632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.334213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 289/552] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:41.335497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.442087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42f77c-e922-4aed-81e1-2815593dff53 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.444901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.445776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3dd85-22fb-45ee-b8f5-76ea079465d5 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.458255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.479548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.480155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.480428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.480727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.481451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:41.481753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.483135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826759ce-1e98-4a77-b706-c91e9470c5c0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.484594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3e2c2-b105-42b4-8714-87edbdf2e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.485200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e2c2-b105-42b4-8714-87edbdf2e90e None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.485472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e2c2-b105-42b4-8714-87edbdf2e90e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.485734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e2c2-b105-42b4-8714-87edbdf2e90e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.496354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 264/553] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:41.497681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f914e-fc5a-4c18-b51e-fb564c591efc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.497967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f914e-fc5a-4c18-b51e-fb564c591efc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.498243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f914e-fc5a-4c18-b51e-fb564c591efc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.499721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 265/554] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:41.500421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f914e-fc5a-4c18-b51e-fb564c591efc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.558244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3e2c2-b105-42b4-8714-87edbdf2e90e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.559625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3e2c2-b105-42b4-8714-87edbdf2e90e None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.610331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f914e-fc5a-4c18-b51e-fb564c591efc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.645336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.646017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.646430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.646706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.658146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.659638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.668824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 290/555] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:41.670139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.670422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.670689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:41.675276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:41.677328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:41.679333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:41.679333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:41.679333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:41.679333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 266/556] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:41.679333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.685874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.689310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:41.690542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:41.693506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.764685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 291/557] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:41.765593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.799292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d091c3-d397-462a-a362-da9ae7b6eaa5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.843658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.844211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.844489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.844788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.857059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.858714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:41.874776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:41.877467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:41.879517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:41.879517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:41.879517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:41.879517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 267/558] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:41.879517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.891326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e7062-7ad2-49a0-a172-2de78452fcba None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.929461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.930065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.930343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.930714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.931522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:41.931832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.934127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.938667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.944373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.949427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 292/559] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:41.950338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.994024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda78488-d937-45f5-9434-8187c88ec922 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.031850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.032479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.032787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.033058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.044152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:42.049793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.051917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 268/560] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:42.053867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.061760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341f7c-c1e3-4ae8-ab05-f3ce320c7830 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.099380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.100063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.100345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.100707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.101355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.101657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.103237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.116855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 293/561] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.117764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.161580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da8cb-93e0-4319-b04c-7e1f9feec16b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.178894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.186606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.201892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.202525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.202802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.203072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.211020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.212611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:42.224839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.225882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:42.226790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:42.231424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 269/562] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:42.232441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.238616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da402ee-950a-45f0-a3bc-f58d19db0faf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.276364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.277553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.278049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.278512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.279479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.280024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.281783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.296520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 294/563] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.297352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.362378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173f832-79dc-46d5-8b63-cf4d5029fc9b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.399278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.399907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.400188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.400463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.407449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.408931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.416889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5eb23-4ed4-4413-9147-4f464d555a50 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:42.420244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.421313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:42.422203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 270/564] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:42.422680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.439891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.452083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.452794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.453138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.453416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.454133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.454438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.455865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f2f1-c0ae-4d11-a671-1403b53c4937 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.459718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.473620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 295/565] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.474906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ff62-24ce-4b4b-b39c-e94e320c35a3 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.475190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ff62-24ce-4b4b-b39c-e94e320c35a3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.475461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ff62-24ce-4b4b-b39c-e94e320c35a3 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.476695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 296/566] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:42.477684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484497-5ebe-485e-8608-be7a8d96cf71 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.478149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484497-5ebe-485e-8608-be7a8d96cf71 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.478373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484497-5ebe-485e-8608-be7a8d96cf71 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.480055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 297/567] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:42.480769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484497-5ebe-485e-8608-be7a8d96cf71 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.540898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a901e0-b109-4a78-8994-744eae0204df None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.574267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.574884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.575158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.575427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.586316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484497-5ebe-485e-8608-be7a8d96cf71 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.586459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.587821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:42.602410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.603344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:42.605345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:42.605345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:42.605345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:42.605345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 271/568] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:42.605345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.626548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.627345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.627621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.627893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.628587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.628896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.630309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61314cc-2601-4f94-b139-921bd6200cdf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.642340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 298/569] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.643504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76771-ca97-40f4-a331-43db08657ace None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.643782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76771-ca97-40f4-a331-43db08657ace None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.644058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76771-ca97-40f4-a331-43db08657ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.662027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b9e76771-ca97-40f4-a331-43db08657ace None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:42.663229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b9e76771-ca97-40f4-a331-43db08657ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:42.692543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.698507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.705680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f068466-21d6-448d-9204-8f7951fb4e5d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.732470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 299/570] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:42.733796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.734108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.734373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.741030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.741653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.741931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.742204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.752656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:42.753727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.754290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:42.755271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:42.770027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.771048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:42.771994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:42.771994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:42.771994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:42.771994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 272/571] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:42.771994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.827296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 300/572] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:42.828141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.881609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce84d1-5f3f-4bff-b6f9-0c6d3486e0cd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.915584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.916182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.917034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.917306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.917929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.918227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.919614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.925732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.928720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.928912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c6bcd-8365-4ca4-abde-58ad74606277 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.932722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 273/573] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.933594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.966058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.966648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.966922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.967190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.967900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=eb23346704d74ab8aea1a295ab75cde8) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.968202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.969857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.975320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 301/574] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/role_assignments?user.id=eb23346704d74ab8aea1a295ab75cde8&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.976015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.048607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049c969-10ff-4a19-95e7-a1cebef9c922 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.088796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.089455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.089734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.090009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.094215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf106e-908f-4997-9df4-264db8fe57b9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.103228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:43.109546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:43.110540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 274/575] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:43.112287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.145760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.146269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.146653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.146921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.147555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.147853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.149232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.165989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 302/576] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.165989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.189997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.193485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.238913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd3e3c-02c4-4932-870d-5ee066226163 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.274525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.275145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.275416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.276062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.279997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6177-7350-4fdc-8d35-0666881f82bc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.288300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:43.294798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:43.295903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:43.296967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:43.298571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 275/577] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:43.299431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.322710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.323515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.323904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.324277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.332099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.333679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:43.345846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:43.347138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:43.348270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:43.353311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 303/578] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:43.354714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.412768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155e79-d32f-4a5c-968e-3d852d4649c1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.434802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.442175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.453058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.453724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.454006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.454273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.454925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.455225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.456606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.459627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece8a37-3b0a-4caa-8469-1ce09de0dfa3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.467867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 276/579] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.468856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.500306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.501127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.501503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.501855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.508706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.510400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:43.521897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:43.522933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:43.523967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:43.530894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 304/580] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:43.530894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.581632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820217dd-0bad-4db8-8581-fad1351486e3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.620946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.621682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.621966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.622255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.622889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.623193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.624578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.637116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 277/581] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.637116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.640991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5abec2-b8f8-4570-9f67-0c3a239ab2bc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.676953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.677476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.677751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.678021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.678742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.679051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.680482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.691393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.704608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 305/582] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.705261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.707856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.757872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9d0e5-8957-49f9-a4ce-e8cc2274fa61 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.797699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.798328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.798598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.798874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.811160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.813639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.818994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b73b-97f2-4b4b-80e3-0a96228af18b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:43.830560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:43.831497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:43.832368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:43.832368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:43.832368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:43.833009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 278/583] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:43.833506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.859034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.859635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.859911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.860180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.861003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.861421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.862844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.880527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 306/584] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.880527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.935545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.942461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504777be-2c5d-42fc-8307-35ed38011093 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.947257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.981418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.982285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.982285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.982576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.988257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53fb86-90e6-4e72-a72d-b61821a5b18a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.993217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.994715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:44.008984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:44.010741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:44.011988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:44.011988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:44.011988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:44.015089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 279/585] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:44.015947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.028920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.029646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.029993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.030334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.041331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.042983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:44.058023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:44.058996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:44.059874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:44.059874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:44.059874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:44.059874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 307/586] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:44.060097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.137484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ab8b1-f41c-44fb-a5ed-1d4b39fc6240 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.168705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add62a8-4e17-4623-a863-3f58339ab9d4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.172783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.173391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.173670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.173942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.174573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.174875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.176341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.183545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.190376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 280/587] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.191126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.202367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.209357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.210007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.210282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.210549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/d8ab184b2ae0437d9fb01eac225baf06/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.225912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=d8ab184b2ae0437d9fb01eac225baf06, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.227545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.252675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 308/588] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:44 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/d8ab184b2ae0437d9fb01eac225baf06/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:44.254049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.320546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd80c6-3e93-47bc-be9a-4e4f08cb7cae None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.365623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.365623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.366675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.366979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.368371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.368703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.370979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.382797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b05b-f562-4a6c-a300-5e8e9dc985fb None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.389232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 281/589] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.390171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.431015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.432516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.433255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.433698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.434519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.434965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.436471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.449541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 309/590] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.450682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.477981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.481216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.524989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc144606-3d39-48b2-a7d1-922a3ecd6ab9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.560956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.561596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.561878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.562145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.567683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccf3a6-2d9e-4f94-9952-f5c3c3c4ce2f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.577610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.579258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:44.591971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:44.592964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 282/591] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:44.594319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.605839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.606500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.606779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.607049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.616602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.618482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:44.631081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:44.632216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:44.633399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:44.635695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 310/592] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:44.636779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.709468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd0b1-48e6-43b9-b0d0-560a902d6daf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.734825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.738795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.748749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.749382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.749662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.749936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.751562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008802e-a673-48b1-aa1e-9b60d568998b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.756961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.758412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:44.770798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:44.772988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 283/593] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:44.775017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.790202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.790908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.791186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.796124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.796352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.796701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.798497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.818768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 311/594] 10.222.0.25 () {56 vars in 1139 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.819818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.890509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55729d-82db-48c7-99fb-67e4eef3bda7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.928082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.929073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.929567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ada37-eef8-42a9-aa40-e76d474fb1ac None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.929761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.930286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.931292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.931907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.933545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.956490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 284/595] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.957837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.966117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.966714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.966941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.967214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.967906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.968212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.969858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.988683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 312/596] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.989643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.992609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.016613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.076693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56d1b-84d5-4d73-930e-86726ae0c296 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.099149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd8b08-43a5-4143-bd2d-2f27e2e0d828 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.115574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.116591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.117120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.117459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.129836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.131791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.136984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.137614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.137888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.138166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.148938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.150390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:45.151850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:45.152807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:45.153791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:45.153791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:45.153791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:45.153791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 285/597] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:45.153791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-588c717e-e6a0-48a0-8ff2-001b506b000e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:45.171129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:45.172380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:45.173304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:45.173304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:45.173304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:45.173304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 313/598] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:45.173870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac7b80-f28e-4636-b25a-4cb1c5121a1a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.174144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac7b80-f28e-4636-b25a-4cb1c5121a1a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.174407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac7b80-f28e-4636-b25a-4cb1c5121a1a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.175734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 314/599] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:45.180875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac7b80-f28e-4636-b25a-4cb1c5121a1a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.238236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.289769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac7b80-f28e-4636-b25a-4cb1c5121a1a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.296364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.302250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ce1fd-4599-4d70-a4c3-7dbc8fe39bb7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.334231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.334848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.335121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.335405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.336071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:45.336617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.339179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.342362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61ff-82d5-4adb-91ba-36e3300e811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.343478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61ff-82d5-4adb-91ba-36e3300e811d None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.343870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61ff-82d5-4adb-91ba-36e3300e811d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.344201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61ff-82d5-4adb-91ba-36e3300e811d None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/099e4db05ff34c9bad67022f4484c108/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.355279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 315/600] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:45.356821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.361449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61ff-82d5-4adb-91ba-36e3300e811d None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=099e4db05ff34c9bad67022f4484c108, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.363637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61ff-82d5-4adb-91ba-36e3300e811d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.381980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 286/601] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:45 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/099e4db05ff34c9bad67022f4484c108/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:45.383504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.383970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.384449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.409375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:45.411096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:45.515064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 287/602] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:45.515913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.521390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c4d9-d811-4fa2-be36-eff93e1c7cf4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.543422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.568325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.569368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.569889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.570382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.571446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:45.572006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.574263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.589571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 316/603] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:45.590964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.617381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.650105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552801e3-af00-4022-9f56-5b966b9f1239 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.705847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.706990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.707338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.707733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.717728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.720009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.727425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae97b2-3ea9-4a9b-af8a-0a8f7f4bd46f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:45.737632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:45.738614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:45.739497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 288/604] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:45.739976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.792109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.792109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.792109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.792109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.814235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:45.821790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:45.822929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:45.824084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:45.826772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 317/605] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:45.831966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:45.874839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.908618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec687-307b-4e90-8cbd-8e09a01f634c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.954501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:45.955922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:45.956443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:45.956954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:45.966654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b9830-9773-47f6-b26a-47bfa7e91e1b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:45.967480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:45.969545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:45.971928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:45.986801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:45.987767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:45.989097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:45.997169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 289/606] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:45.998652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.020292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.021097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.021475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.021839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.022637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:46.023047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.024605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.040937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 318/607] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:46.042431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.140591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bbaa-391c-4e29-acd1-af0060e99e75 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.162438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:46.173008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a5c7-54d1-4e8b-a167-8dab89c612a9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.178852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.179573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.179957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.180328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.181134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:46.181557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.183753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.196961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 290/608] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:46.198559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.220092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.220974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.221410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.222365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.223206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:46.223911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.226226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.248012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 319/609] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:46.249442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.270823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:46.317509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd55f-64c4-48f2-a692-7f2d0bdf115c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.355949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.356837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.357234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.357636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/15c36ce12e5b4f25848137a9dc590f55/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.374954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=15c36ce12e5b4f25848137a9dc590f55, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.376531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.392981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39170ec8-16b2-47f1-b97c-0a13ddcee885 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.395409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 291/610] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:46 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/15c36ce12e5b4f25848137a9dc590f55/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:46.396715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.487907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.488554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.488850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.489148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.507296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.508863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-1e8eac6a-8280-44a2-b2a5-6a9e1c5ae56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:46.525813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:46.527071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:46.527967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:46.527967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:46.527967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:46.528143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926cf9a-55b8-4557-a6b8-1dfa0ee429a9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.528216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 320/611] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:46.529568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b7f36-60f1-4c6d-920a-9ce19e9a37f8 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.529942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b7f36-60f1-4c6d-920a-9ce19e9a37f8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.530302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b7f36-60f1-4c6d-920a-9ce19e9a37f8 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.531935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 321/612] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:46.533953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b7f36-60f1-4c6d-920a-9ce19e9a37f8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.543268 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:46.544001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:46.577768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f08c5-1b4b-4880-a51b-fdab2e40534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.578507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f08c5-1b4b-4880-a51b-fdab2e40534c None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.578879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f08c5-1b4b-4880-a51b-fdab2e40534c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.579247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f08c5-1b4b-4880-a51b-fdab2e40534c None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/9ab6c2c2f06040d09952c23e76d2c8b6/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.596420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f08c5-1b4b-4880-a51b-fdab2e40534c None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=9ab6c2c2f06040d09952c23e76d2c8b6, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.598056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f08c5-1b4b-4880-a51b-fdab2e40534c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.618069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 292/613] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:46 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/9ab6c2c2f06040d09952c23e76d2c8b6/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:46.619919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.620228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.622214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.654990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:46.657128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:46.680591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b7f36-60f1-4c6d-920a-9ce19e9a37f8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.723541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426807c-9119-4758-884d-6257f4158512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.724090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426807c-9119-4758-884d-6257f4158512 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.724435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426807c-9119-4758-884d-6257f4158512 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.724817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426807c-9119-4758-884d-6257f4158512 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.725530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426807c-9119-4758-884d-6257f4158512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:46.725898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426807c-9119-4758-884d-6257f4158512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.727588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426807c-9119-4758-884d-6257f4158512 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.742521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 322/614] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:46.749347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426807c-9119-4758-884d-6257f4158512 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.752845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 293/615] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:46.776544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:46.844640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:46.890044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426807c-9119-4758-884d-6257f4158512 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.935998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:46.936717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:46.936992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:46.937319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:46.937916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:46.949717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:46.952878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:46.954602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fadc1-426c-4e0f-a5a4-7759c525b3c5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:46.969601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:46.970908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:46.971840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:46.974867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 323/616] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:46.983770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.002953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.004935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.005910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.007153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.029508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:47.036380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:47.037325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:47.038147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:47.047901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 294/617] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:47.049633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.137696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba29a9-c559-474f-b896-f30c74affb71 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.159228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f51af-3eee-4a57-a88c-5a08ff2bc902 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.165621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.176287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.176922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.177203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.177477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.178208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:47.178516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.179948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.198777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 324/618] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Aug 7 18:07:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:47.199897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.200925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.201496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.201959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.202802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:47.203292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.204213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.205303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.215509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 295/619] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:47.221207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.237856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.327077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8732e8-7d07-42d0-af94-33f3ac1336f2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.329848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9264-8dd6-4743-88d0-7fe1a2d8d5fd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.365521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.366532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.367045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.367526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.379609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.381391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:47.396451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:47.397582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:47.398479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:47.398479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.398479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:47.404588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 296/620] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:47.407163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.429271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.429916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.430193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.430464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.454470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.455938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.475229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:47.489830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:47.490807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:47.491676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:47.491676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.491676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:47.491676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 325/621] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:47.496551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.519606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9d3ad-a232-42a0-883e-c2451ea46745 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.555235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.556248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.556745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.557262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.558089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:47.558581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.560147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.568721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.573986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 297/622] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:47.579683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.681233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db43aa-e89a-4e14-a12b-fb2af8819a40 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.703004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ec42-0898-4c1d-8189-741a5fad31d7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.720748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.741080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.741707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.741978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.742245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.750907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.752372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:47.770160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:47.771177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:47.772108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:47.773568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 298/623] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:47.780037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.780669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.780993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.781264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.781950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:47.782296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.783713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.795141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.823423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 326/624] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:47.831932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.919890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087fb0-5270-4c59-a294-882ccad67e77 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.959031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.966475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07631-3cf8-4c14-8873-34f06da24c80 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.977622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.978234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.979571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.980044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.981316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:47.981430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.983141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47fa36-364b-4421-8eae-1729a827821d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.004959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 299/625] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:48.005668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.006266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21348583-afdd-4491-b8ee-facdb473602c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.006554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21348583-afdd-4491-b8ee-facdb473602c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.006827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21348583-afdd-4491-b8ee-facdb473602c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.007280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.007701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.008117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.012612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 300/626] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:48.013520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21348583-afdd-4491-b8ee-facdb473602c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.016323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.018027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-c8e909d2-7632-42e1-9b48-dc913c01d707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:48.031757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:48.032949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:48.033929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:48.035864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 327/627] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:48.042018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.042554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.043120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.061891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:48.063377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:48.063933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.127034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21348583-afdd-4491-b8ee-facdb473602c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.133527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 328/628] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:48.134551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.189979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.190592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.190868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.191140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.223437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.239905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60e3b-696a-4020-8242-eb95289b2d26 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.267763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.269272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.275853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.276721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.277149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.277566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.278402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:48.278861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.280422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.298530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 329/629] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:48.299636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.329132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.380588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 301/630] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:48.381475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.407211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7c4b-88d4-44cf-9b07-36c1b5ed09e3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.443107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.443987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.444435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.444890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.455819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:48.461204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:48.462333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:48.463383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:48.465584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 330/631] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:48.466527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.475669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.498800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e74cd-f36f-4684-9388-1e41bf41fb60 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.537823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.538491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.538773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.539053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/eb23346704d74ab8aea1a295ab75cde8/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.555604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=eb23346704d74ab8aea1a295ab75cde8, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.558026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.563267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.580954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 302/632] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:48 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/eb23346704d74ab8aea1a295ab75cde8/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:48.582214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.590481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814c28b-dbd9-4e2b-90a1-3ae22df8f273 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.631032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.631032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.631032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.631032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.648622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.648622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:48.660430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:48.661600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:48.662498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:48.662498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:48.662498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:48.662498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 331/633] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:48.667971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.771783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154cb51-5c63-4ac1-923a-1c5d53aeba8d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.800085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.820937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.821816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.823058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.823466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.824275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:48.829047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.831148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.843410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 303/634] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:48.849382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.863105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e2e8-8406-49bf-9e1d-3019c6331e43 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.927248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.945300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.945914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.946205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.946456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.947103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:48.948349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.948870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd68b7b-5f08-4806-a89e-e435a38e4918 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.961615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 332/635] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:48.962853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20776f-be30-4467-b272-aa9efa40e134 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.967278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20776f-be30-4467-b272-aa9efa40e134 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.967278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20776f-be30-4467-b272-aa9efa40e134 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.967278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 333/636] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:48.968578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20776f-be30-4467-b272-aa9efa40e134 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.986247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c40ec-b9fa-4812-ac83-25e0bda983d5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.021262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.021950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.022181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.022456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.034348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.035807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cda719ba-8bb1-4fd2-8f2c-dbb25b39f6f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:49.051871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:49.053305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 304/637] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.059075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.076969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:49.078149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:49.078420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20776f-be30-4467-b272-aa9efa40e134 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.097741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.115833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.116462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.116767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.117057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.123797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.125275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-39e32772-a041-4ea7-a853-c6aa1b8fc746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:49.137141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:49.138146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:49.139161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:49.143064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 334/638] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:49.144326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7116-d9c4-4372-8169-cdbed18532b7 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.144657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7116-d9c4-4372-8169-cdbed18532b7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.144941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7116-d9c4-4372-8169-cdbed18532b7 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.146328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 335/639] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:49.149300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7116-d9c4-4372-8169-cdbed18532b7 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.157371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 305/640] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:49.158182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.195370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.258978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7116-d9c4-4372-8169-cdbed18532b7 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.265571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af050-94f8-458f-a8c3-6c1b5aabe607 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.298326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.298981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.299221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.299488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.300127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:49.300413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.301823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd79ee-e454-49f6-bafa-a49029f8a2fb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.303939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.304636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.304984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.305327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.306074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:49.306449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.308538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.318986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 336/641] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:49.318986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.318986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.318986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.330563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 306/642] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:49.330563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.336769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:49.338737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:49.372003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.420936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 337/643] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:49.420936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.439046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.446680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402a3d-4bec-476c-b371-f82bf324c543 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.485682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.486309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.486584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.486855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.497957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:49.502988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:49.504038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 307/644] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:49.504952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.539333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af34544-0cec-4ae4-ac98-a46d0a377c1f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.576718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.577205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.577489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.577748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.584888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.586315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:49.598533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:49.599462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 338/645] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:49.600533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.616709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cf11a-9e92-444b-958c-8fd120db22e4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.629845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.652956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.653548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.653819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.654201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.654900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=d8ab184b2ae0437d9fb01eac225baf06) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:49.655319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.656768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.672823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 308/646] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/role_assignments?user.id=d8ab184b2ae0437d9fb01eac225baf06&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:49.672823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.700709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.715446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d73d-b8a2-4e03-b72c-83b1d1066291 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.755262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.755968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.756245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.756513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.772214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:49.779949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:49.781008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:49.781829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:49.784706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 339/647] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:49.785991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.811599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb15fe1-f686-4680-ba25-77d0f92854e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.853423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.854146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.854331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.854640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.855303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:49.855602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.857027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.866380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 309/648] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:49.867036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.906895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.922188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5670-4dfa-4b4d-aa19-20b66d717ca1 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.960683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.960871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.961478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.961752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.962018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.964114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:49.964114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.965244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.985946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 340/649] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:49.986784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.989560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481fb9-d045-4062-88d1-02340f59b3e5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.035803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.037222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.037747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.038220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.039347 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:50.039817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.042289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.053321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 310/650] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:50.054475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.111080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82444b2-612d-4193-97fc-f7ffa8009843 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.155835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.156839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.157270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.157634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.170891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.173236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.181437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52913b-8e41-47be-9d8d-9168be95942a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.183015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:50.194503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:50.195667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:50.196807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:50.196807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:50.196807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:50.202947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 341/651] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:50.202947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.230489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.231800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.232231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.232950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.252637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.317222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.317987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9acf9-73a6-458a-b3f3-4b52deb10972 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.319233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.354351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.355173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.355455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.355733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.367017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.368410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:50.383700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:50.384703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:50.385854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:50.385854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:50.385854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:50.385854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 342/652] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:50.386529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.438555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 311/653] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:50.439243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.440368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.490243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.491745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04851bf0-679a-4aac-8e46-af4f194042ee None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.527504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.528120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.528400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.528699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.529435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:50.529663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.531018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.550952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bc412-58da-4dba-9dac-f82680505b61 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.555423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 343/654] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:50.556333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.591669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.592843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.593414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.593878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.594721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:50.595228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.596971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.610546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 312/655] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:50.611748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.669473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d146c68-2687-431c-84fe-cdaf6e03ff87 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.680321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.705838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.706250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.706533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.706807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.717370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.718828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.722937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478842-5ac4-403f-98e6-8d24cfd4515d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:50.735349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:50.736306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:50.737211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:50.737211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:50.737211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:50.737388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.740886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 344/656] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:50.741796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.763646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.764629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.765128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.765708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.774261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.776670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:50.788275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:50.789257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:50.790184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:50.793219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 313/657] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:50.794214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.860120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba85fe-05b9-46a2-8e23-3ebfee136374 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.896352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.897088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.897434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.897782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.902297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a6fe-5885-434a-badd-7c1c18c006b2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:50.906425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.907881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2647b00b-87fb-4599-9ee7-84575441168b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:50.920169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:50.921128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:50.922064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 345/658] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:50.923465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3a442-d878-432c-b8ef-682d225e77c4 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.923465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3a442-d878-432c-b8ef-682d225e77c4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.923465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3a442-d878-432c-b8ef-682d225e77c4 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.928467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 346/659] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:50.928467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3a442-d878-432c-b8ef-682d225e77c4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.945460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:50.946078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.946346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.946610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.947260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:50.947667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:50.949265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:50.955653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.963610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 314/660] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:50.964492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.990062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.047904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3a442-d878-432c-b8ef-682d225e77c4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.071211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96a68b-7dc1-4edf-ae65-a5446c230fb1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.087768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.088919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.089282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.089704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.090266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.090567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.091989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c211b-877d-455d-8f18-8454b7d62335 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.106845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.107446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.107725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.107997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.108740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.109046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.110461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.111518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 347/661] 10.222.0.25 () {56 vars in 1139 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:51.113397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.113680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.113954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.132251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 315/662] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:51.132598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:51.133451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.133875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:51.216623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 348/663] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:51.216623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.230431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.232226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.253127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598cf9f-6ecb-4a81-a63c-04e4cfada75f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.287521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.288150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.288426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.288734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.296160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.297633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:51.309503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.310430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:51.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 316/664] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:51.312157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.334919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50081e7-6c10-46a4-988e-e89ec7197021 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.370323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.370930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.371208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.371479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.423481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0fb-4f95-4ffe-b010-bd2ecd60fecc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.440063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.441557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.453840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.462794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.463716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.464236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.464585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.477522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.536463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.537989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.651699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 317/665] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:51.651699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.669814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 349/666] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:51.670659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.701383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.763407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db14d17-529b-45f4-8742-bee072513f71 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.780316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7f803-6206-4cf3-bc45-34cdccc50ba7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.794600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.804065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.804737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.805479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.805760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.818465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:51.823349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:51.823488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.824384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:51.825273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:51.825926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.825926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.825926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.826114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 318/667] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:51.826114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.829267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.830103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.832441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.846640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 350/668] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:51.852287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.926499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97515134-c038-4657-9afa-f5323d1bcdbc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.928121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.955004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427686bd-68ea-4a11-8830-6bf180b3d268 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.960133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.960783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.961065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.961337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.971913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.973376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:51.987962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.989142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:51.990653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:51.990653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:51.990653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:51.990653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 319/669] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:51.990653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.993426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.994042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.994374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.994698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.004765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.006225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:52.021869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.022963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:52.023846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:52.023846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.023846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:52.023846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 351/670] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.023846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.053325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.099029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f0d19-8f20-4349-a84a-b033ba31fe96 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.129289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ab25-4b27-48f5-98ee-6bb684231005 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.131129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.131729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.132004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.132276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.132946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.133243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.134588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf5fd-1a29-42ca-baaa-d58e6b8d5dac None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.143027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 320/671] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.144167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b39cf-f9ec-40dd-a0b1-ad7c6db39c28 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.144444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b39cf-f9ec-40dd-a0b1-ad7c6db39c28 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.144742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b39cf-f9ec-40dd-a0b1-ad7c6db39c28 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.146110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 321/672] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:52.150579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b39cf-f9ec-40dd-a0b1-ad7c6db39c28 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.164531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.165154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.165430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.165703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.166486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=099e4db05ff34c9bad67022f4484c108) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.166833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.168259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.169436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.174517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 352/673] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/role_assignments?user.id=099e4db05ff34c9bad67022f4484c108&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.175295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.271618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.280059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b39cf-f9ec-40dd-a0b1-ad7c6db39c28 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.289304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd3d3-20b5-4120-8d2e-b774b7b50133 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.319580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.320283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.320584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.320863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.321502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.321800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.323313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.330625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.331234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.331505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.331769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.333290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.333290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.334052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45633cf2-3db5-4625-99d6-7f5f3017ab19 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.340792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 322/674] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.341711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.348474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 353/675] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.349734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.350015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.350284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.370606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:52.371897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:52.436259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.448585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 354/676] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:52.448585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.462410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991ff2-e3b8-4865-b85c-9ff398e40be5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.498938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.499564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.499838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.500240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.511574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.513166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.523717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:52.530257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.531352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:52.533052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:52.533052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.533052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:52.533052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 323/677] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.533052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.551097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6de6cf-fdc3-4675-b01d-aca255bf2daa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.587286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.587912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.588753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.588995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.595925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.597538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:52.609845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.610964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 355/678] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.612170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.647717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dbfa1-8bb2-449d-b349-279767bb1849 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.675686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.684956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.685661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.685959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.686233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.693162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.694603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:52.706500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.707424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:52.708304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 324/679] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.708818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.725074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404cef6-f5c7-49de-aaf4-a47d45c1a8be None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.759131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.759750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.760743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.761081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.763724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.772911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.774341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:52.788616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.789550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:52.790457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:52.790457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.790457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:52.795411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 356/680] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.796310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.827135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a3df9-1767-4e99-9039-bc93dc235543 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.862504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.863113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.863393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.863666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.864298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.864625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.865988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.880602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 325/681] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.880602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.910626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eba90-b156-4d0d-b444-46ff3ec68a4c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.935398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.949211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.949820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.950099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.950370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.951059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.951367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.952818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.965122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 357/682] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.965939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.002006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be677c64-930f-454a-aedb-9e640ead9d69 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.016784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.047222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.048303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.048766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.049358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.050584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.051299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.053069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.065910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 326/683] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.067414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.069189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c628fb-3e9a-4387-af29-a27124a0b116 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.105936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.106533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.106842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.107053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.108150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.108150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.109322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.126059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 358/684] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.126059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.184474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e074-baf6-47d0-910b-29ecad779e72 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.194165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.221745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.222381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.222654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.222925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.230924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.232384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.233277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d76111-94d0-4811-90ac-c39485672ce7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:53.243233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.244758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:53.245911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:53.246513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.246586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 327/685] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.246586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.277429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.278186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.278556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.278899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.279674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=9ab6c2c2f06040d09952c23e76d2c8b6) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.280050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.281567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.296625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 359/686] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/role_assignments?user.id=9ab6c2c2f06040d09952c23e76d2c8b6&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.296625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.376456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8da49-0302-4c15-9a8c-b7e1acf2fc6e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.411267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde75e5-538f-462f-9955-be26c00e5bae None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.415673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.417335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.418000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.418430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.419341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=15c36ce12e5b4f25848137a9dc590f55) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.419826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.421611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.436607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 328/687] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/role_assignments?user.id=15c36ce12e5b4f25848137a9dc590f55&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.436607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.480131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.482341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.484169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.484578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.485419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.488542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.506468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.517953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 360/688] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:53 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:53.599536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f573-c8bd-4727-bc3d-597fa8fe52a9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.640421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.641159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.641530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.641900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.642733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.643133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.644728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.666848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 329/689] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.672539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.704480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.781609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cc3a6-b24c-43ac-9e79-8a3453fd9cb5 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.817158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.817769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.818041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.818307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.893146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.894510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.925300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.998542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 361/690] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:54.004078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.101245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.112003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1afa6-dc86-470d-9135-3368e3e9c29b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.146553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.147134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.147412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.147677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.158487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.159929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:54.175081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:54.176052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:54.176980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:54.176980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:54.176980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:54.176980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 330/691] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:54.182065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.284428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830be54-3cfc-4176-8465-ae861e38a35f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.314106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.321884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.323438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.323715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.323983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.324644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.325185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.326948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b980-8125-447d-a188-6b84ae3daaac None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.339806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 362/692] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.345316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.406015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5728-5f60-4bd3-a8ea-73c311b456c9 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.406189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5728-5f60-4bd3-a8ea-73c311b456c9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.406462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5728-5f60-4bd3-a8ea-73c311b456c9 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.407769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 363/693] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:54.425943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.426264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.426472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.459280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:54.460462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:54.491579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b521e-874b-4f66-b90e-e1787e61fb36 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.550037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 364/694] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:54.573540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.573843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.574183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.574465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.574738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.592592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.594069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:54.617687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:54.618661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:54.620480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:54.624399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 331/695] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:54.629485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.632333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.679982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b45c96-5961-44be-9485-c00f25fd2d0c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.700922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.719931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.720582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.721167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.721449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.733065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:54.738349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:54.739312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:54.740160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 365/696] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:54.748253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.829031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e8f4-29db-49d5-9056-8395c6dfc757 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.881868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.882481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.882758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.883030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.883723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.884029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.885531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.913524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 332/697] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.919975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.937598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e8a0a-dec3-4d96-9989-6aa7172b3b58 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.976670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.977278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.977603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.977879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.978582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.978906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.980344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.997125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 366/698] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:55.004259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.030368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.052299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.089170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d07fa-8970-442c-b205-5b889d6b34c1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.128064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b3a4-35df-4e1f-904c-340e414e6c53 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.145178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.145817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.146094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.146367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.147088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=eb23346704d74ab8aea1a295ab75cde8) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.147393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.149035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.155790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 333/699] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/role_assignments?user.id=eb23346704d74ab8aea1a295ab75cde8&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:55.219010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.220085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.220616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.221097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.240819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.242674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:55.262734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:55.263773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:55.264715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:55.264715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:55.264715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:55.266920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 367/700] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:55.272195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.408594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f24412-3a7c-4a61-9624-da6015fb8bb4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.437277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.448542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.450706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.450997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.451340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.451990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.452344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.453754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.467417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 334/701] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:55.472627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.577705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.589093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e567d9-8120-45cb-93bf-4e20e568fd1b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.626963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.627587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.627859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.628128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.636806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.638260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-079c7fab-4205-46ee-9d92-8ee7a29826c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:55.649972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:55.651548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:55.652470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 368/702] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:55.657101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.765785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971ef2-e130-49aa-a1ac-63afc0aa88ce None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.818194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.818815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.819091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.819362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.820087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.820389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.821838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.830524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2998c-b883-4cab-9252-9fbc4808561f None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.830809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2998c-b883-4cab-9252-9fbc4808561f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.831077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2998c-b883-4cab-9252-9fbc4808561f None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.835680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 369/703] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:55.841090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.841368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.841642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.842008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 335/704] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:55.847353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.871681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:55.872918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:55.936998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.014184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 370/705] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:56.030127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d3be-262b-48d3-bab8-285a8943ae55 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.036093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.106143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83209a24-fb1d-4969-b717-94ff4f3f8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.106811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83209a24-fb1d-4969-b717-94ff4f3f8cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.107032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83209a24-fb1d-4969-b717-94ff4f3f8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.107309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83209a24-fb1d-4969-b717-94ff4f3f8cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.176899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.204095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f189-e01e-484e-bc62-ec6faf52168a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.208916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83209a24-fb1d-4969-b717-94ff4f3f8cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.210460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83209a24-fb1d-4969-b717-94ff4f3f8cf8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.241562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.242578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.243078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.243530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] PATH_INFO: `/v3/services/network` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.244351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.245960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-64233bd9-49c7-4152-86a6-c54c81ba4ead None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:56.257237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:56.258480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:07:56.259530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.262238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 371/706] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:56.263646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616e56-d235-40d6-b237-5b6d997501a2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.263994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616e56-d235-40d6-b237-5b6d997501a2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.264338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616e56-d235-40d6-b237-5b6d997501a2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.265867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 372/707] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:56.269918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31616e56-d235-40d6-b237-5b6d997501a2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.273869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.340833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 336/708] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:56.341998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.342275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.342543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.363329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:56.364651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:56.387187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31616e56-d235-40d6-b237-5b6d997501a2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.422520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.423125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.423403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.423674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.424303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] RBAC: Adding query filter params (name=network) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.424624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.425990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673789-a75d-41d5-9754-ddfbba95c563 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.432600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 373/709] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:56.432600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527ec24-1be4-4cbc-8f88-9003cbb0891d None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.432815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527ec24-1be4-4cbc-8f88-9003cbb0891d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.433105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527ec24-1be4-4cbc-8f88-9003cbb0891d None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.434419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 374/710] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:56.434992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527ec24-1be4-4cbc-8f88-9003cbb0891d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.451882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 337/711] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:56.452073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.452168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.536387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.562198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fd970-3174-446d-9b7d-e740c890c33c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.562447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527ec24-1be4-4cbc-8f88-9003cbb0891d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.598411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.599090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.599304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.599579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.599902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.599996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.600174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.600438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.601080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] RBAC: Adding query filter params (type=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.601373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.602734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0fb1d-212e-447f-a58a-d09c636ea198 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.616594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 338/712] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:56.616594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.616594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.616594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.621401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.622952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.629992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:56.631217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:56.642924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:56.643992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:56.644980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:56.644980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:56.644980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.644980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 375/713] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:56.644980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.729355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 339/714] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:56.729597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.731778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.784963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26b8d2-6659-45bf-ad7a-27a53b8e61d9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.830148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.830801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.831075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.831342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.831524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.831942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.833375 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:56.846093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:56.847299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:56.848129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 376/715] 10.222.0.25 () {56 vars in 1129 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:56.849021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.883288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795e84a-a2d9-4ce3-a94f-fe455d3a62eb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.933562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.934279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.934557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.934822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.935515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.935841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.938392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.956977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 340/716] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:56.956977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.977323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b350082-3598-41fe-b778-ec324fb7f85b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.006580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.017047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.018104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.018586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.019057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.031287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:57.037121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:57.038086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:57.038990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:57.041752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 377/717] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:57.042754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.073210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62fd6-9c75-4995-8440-9f22d89e4dcf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.100994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.110978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.112296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.112812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.113307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.114154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.114677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.116230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.126092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 341/718] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.127485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.154844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300234e-a524-4b09-b529-31fed964fc26 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.199514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.200539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.200838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.201368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.210603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.212317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:57.227329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:57.228276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:57.229933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 378/719] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:57.230903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.245453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56755-9f93-419c-b9ad-54e19e1dc953 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.290864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.295097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.297026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.297457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.297872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.298676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.299711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.301592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.314553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 342/720] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.315659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.367425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a83ca-1cd1-43a5-8c5e-6ffe60cea3fd None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.374812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.404121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.404994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.405412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.405822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.406587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.407060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.408592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.414604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 379/721] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.415572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.428982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24284e-43e0-4c29-b132-d9cb4e1c8a8c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.472379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.473024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.473299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.473568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.474256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.474556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.476044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.491273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 343/722] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.497422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.606857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69deb1ff-240c-4720-8153-b3754bb2c7ee None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.627824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.629296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba94ed5-1868-41fa-a6b2-443b1eb70080 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.659143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.677685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.678363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.678639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.678908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.691465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.692228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.692964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.693280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.693702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.694106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.694976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=099e4db05ff34c9bad67022f4484c108) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.695430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.697009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.704028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 344/723] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/role_assignments?user.id=099e4db05ff34c9bad67022f4484c108&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6a2f1400-133a-48f6-bfac-503ebd7e39f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:57.716092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:57.717219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:57.718415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:57.718415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:57.718415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:57.718415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 380/724] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:57.718699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.774248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a325-9bac-438c-bc7d-1c416a3e2eb2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.774627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a325-9bac-438c-bc7d-1c416a3e2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.774902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a325-9bac-438c-bc7d-1c416a3e2eb2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.777714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 381/725] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:57.785537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.785966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.786341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.814642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:57.816841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:57.840452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60dae2-a5ac-429a-ad23-a98d39a9053e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.881802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.882634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.883010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.883492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.884151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.884456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.886134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.906398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 345/726] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.913044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.930427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 382/727] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:57.977535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.980525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.044545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8220-1fee-471b-81ed-5efa93e72d82 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.089084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.089799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.090075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.090343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.102851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.105383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:58.118769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.120209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:58.121178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 346/728] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.126239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.167066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.177727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4108-53f2-4d7f-ad5e-0e44911668ca None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.215325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.216056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.216334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.216625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.227410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:58.236601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.237549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:58.238368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 383/729] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.239642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.358815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770146ba-962c-4329-be51-7adeb35d1d5e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.360890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.398249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.399002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.404580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.404580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.404580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:58.404580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.404580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.424317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 347/730] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:58.429296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.458731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecf935-52e8-472b-81c9-694fddad10ad None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.505242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.506025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.506383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.506801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.507561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:58.507952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.509526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.518907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 384/731] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:58.529353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.550944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.567577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa2d-dde8-4ddf-9fd5-f35f555b5e39 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.613855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.614482 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.614754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.615017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.667725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104f04-4f19-462c-8c29-c0f1ec23fcb4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.690818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.706354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.706980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.707252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.707522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.719304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.720926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:58.736456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.737447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:58.738331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:58.738331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.738331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:58.738331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 385/732] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.743072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.796634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.797027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.912881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 348/733] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:58.924714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.947651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.997475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.040106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef82d5d-6b00-41b9-b226-0e9b998b4b33 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.051127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9553caf-a8db-4fb2-aaf7-4eb7c3b84389 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.085607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.086701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.087197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.087666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.088906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.089636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.092008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc916139-9231-4a06-bdaf-3b1c3dcf84d6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.096483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.097176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.097455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.097732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.108659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 386/734] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.110302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03030-8b8c-4baa-8482-1fcaaf12ef04 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.110589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.110989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03030-8b8c-4baa-8482-1fcaaf12ef04 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.111455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03030-8b8c-4baa-8482-1fcaaf12ef04 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.112069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.117574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 387/735] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:59.118578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03030-8b8c-4baa-8482-1fcaaf12ef04 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b166a86f-7453-4ae1-8433-277f19cea24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:59.129953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.131225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:59.132119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:59.132119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:59.132119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:07:59.132119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 349/736] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.132788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.132955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.133205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.156527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:59.158081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:59.231104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03030-8b8c-4baa-8482-1fcaaf12ef04 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.248772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 350/737] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:59.248772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.283294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.293967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.302097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.302945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.303839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.304265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.314261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.316817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:59.333793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.334939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:59.336102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:59.338315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 388/738] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.339327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.374432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bde3d-1f27-4dbc-981b-74f1c7683785 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.413185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.414050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.414428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.414794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.415527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.415959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.417732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.430635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 351/739] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.432282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.473841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d46b2-1457-4c5e-af25-fb3031b680e3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.521352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.521874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.522148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.522419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.523057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.524421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.552061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 389/740] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:07:59 2022] POST /identity/v3/services => generated 240 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:59.553127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.564993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.571271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5032-fafa-4bd9-88ce-ff16b7bf7f33 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.620186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.621203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.621690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.622229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.623274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.623878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.625579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.641995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.649472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 352/741] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.655295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.792047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e2e28-8f67-4625-9213-24b1a7ce9a24 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.814699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cf72a-9c0c-4c19-8bbc-f7054f9a9a03 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.842947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.843589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.843863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.844132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.853661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.855225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.861963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a75bb1-b41f-4fcd-b79d-e4f790f39a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.863119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75bb1-b41f-4fcd-b79d-e4f790f39a85 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.863581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75bb1-b41f-4fcd-b79d-e4f790f39a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.864034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75bb1-b41f-4fcd-b79d-e4f790f39a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-18322e09-b17b-4555-8819-795488f9cbd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:59.869716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.870711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:59.871598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:07:59.872865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 390/742] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.874285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f774-f767-4e74-b211-d5ba70e462a5 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.874804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f774-f767-4e74-b211-d5ba70e462a5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.875859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f774-f767-4e74-b211-d5ba70e462a5 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.877642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 391/743] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:59.880638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1f774-f767-4e74-b211-d5ba70e462a5 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.898416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.963415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a75bb1-b41f-4fcd-b79d-e4f790f39a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.965633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a75bb1-b41f-4fcd-b79d-e4f790f39a85 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.010041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1f774-f767-4e74-b211-d5ba70e462a5 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.018668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.056454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.057555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.057835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.058097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.058794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.059102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.060696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de10f-0a1f-4673-944a-eb361b75f8db None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.079007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 392/744] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:00.080741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f343-da5b-4355-bf5c-9bcfab5bb5ee None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.081032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f343-da5b-4355-bf5c-9bcfab5bb5ee None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.081309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f343-da5b-4355-bf5c-9bcfab5bb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.102272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d522f343-da5b-4355-bf5c-9bcfab5bb5ee None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:00.103637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d522f343-da5b-4355-bf5c-9bcfab5bb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:00.177810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 393/745] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:00 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:00.179084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6db76-5d56-46f6-aac0-ff6943bb9faf None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.179358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6db76-5d56-46f6-aac0-ff6943bb9faf None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.179622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6db76-5d56-46f6-aac0-ff6943bb9faf None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.185529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 394/746] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:00.185529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6db76-5d56-46f6-aac0-ff6943bb9faf None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.218380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 353/747] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:00.220210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.220668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.221103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.240451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:00.241680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:00.280311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.288326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6db76-5d56-46f6-aac0-ff6943bb9faf None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.293503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.318159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 354/748] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:00 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:00.318911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.331894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.332922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.333402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.333910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.334942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=52b6f0f0ede94e629574bc502166e36b) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.335446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.337208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.344229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 395/749] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/role_assignments?user.id=52b6f0f0ede94e629574bc502166e36b&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:00.345112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.440911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406f4b6-856b-4975-ab8d-ab7cee3f8b41 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.480957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.481972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.482470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.482950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.483833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.485355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.508011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a97d1a-6493-4537-a018-33ba2d68ffc6 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.513357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 355/750] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:00 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:00.515533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.575727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.575953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.576051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.576316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.581012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.589924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.591322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:00.608530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.609596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:00.617294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:00.617294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:00.617294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:00.617294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 396/751] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.617294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.628800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.678993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6d45-5b75-4bd2-be5a-6fe4cf60bf4f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.728605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.728605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.728605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.728605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.752208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:00.755431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6964-1450-410c-85d7-3457c2102029 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:00.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.758463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:00.759301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 356/752] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.767181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.803038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.803038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.803038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.803671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.803744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.804037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.805428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.821175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 397/753] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:00.827173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.925035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.938380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6349794-ed55-4ee9-bf31-6dc976208976 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.941156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.983326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.984313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.984977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.985455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.986472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.986993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.988985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.999094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 357/754] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.004609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b6a71-5477-4c47-8a92-d1bec17c7e13 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.005645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.058641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.060742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.062337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.062761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.074791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.076509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:01.106379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.107472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:01.108400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:01.110515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 398/755] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:01.115681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.212712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0eeb3-8576-4e19-99cf-54ffa5763089 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.225741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a2307-5631-41f9-aeb8-5fefcfd24cea None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.255923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.272525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.273157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.274203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.274479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.275174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.275672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.277685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.289747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.290379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.290658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.291467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.299823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 399/756] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:01.303363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.304836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.305676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:01.322798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.323845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:01.324756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:01.324756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:01.324756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:01.325478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 358/757] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:01.337553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.371947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.425125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a63ad-c2a2-404b-b62c-6adbfb1df190 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.467322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.467931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.468207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.468478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.469231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=eb23346704d74ab8aea1a295ab75cde8) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.469540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.470973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.483866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 400/758] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/role_assignments?user.id=eb23346704d74ab8aea1a295ab75cde8&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:01.555676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d10eb-d2f3-4700-825a-4b2468fe8658 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.597981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.598616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.598966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.599242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.599908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.600214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.605983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe1b8-ed40-4d68-8085-192f8ee5fe74 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.624897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 359/759] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.626394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.721817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.786381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e9b99-0458-4397-8a5a-bdf335f5c540 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.839333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.839983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.840223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.840500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.848759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.850197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.859110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0dde5-c3e6-4d39-ac6e-6b42dc9f7567 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.859693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0dde5-c3e6-4d39-ac6e-6b42dc9f7567 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.860169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0dde5-c3e6-4d39-ac6e-6b42dc9f7567 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:01.863839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.864800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:01.866065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 401/761] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:01.866989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 360/761] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:01.869681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.870781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.871271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.871749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.913630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:01.915168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:01.976765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4b0b5-caa4-42a5-8003-3c3eaf07a7f3 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.990963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.015279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.015890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.016168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.016443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.017213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.017516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.018946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.038137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 402/762] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:02.044417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.094812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 361/763] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:02.136847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.151239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.160602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac3ff-5564-4f4f-b84e-ce9fc1e263bc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.190894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.191432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.191716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.191986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.214077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.215545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:02.250869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:02.251880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:02.252782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:02.252782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:02.252782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:02.260716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 403/764] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:02.274644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.320938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.347889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf29fbf-7ead-4c83-8a1a-935748d96adb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.423992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.424665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.424947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.425277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.425874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.427309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:02.443706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:02.444741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:02.445990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 362/765] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:02.457956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.480439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dfeb8-7b78-4d4f-8e20-870d6a5ab8ab None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.543914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.544520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.544819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.545223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.545869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.546226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.548833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.568951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 404/766] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:02.574364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.601122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.652594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40c8b2-a2f3-4875-81da-afe14b40e4e2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.695799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.696337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.696646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.696927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.698739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] RBAC: Adding query filter params (name=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.699055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.701185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d322c-bfd6-45cc-9477-654b10782aef None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.703582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.708690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 363/767] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:02.710168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c85e-0fb1-4207-92a4-1b114d77c5fa None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.710671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c85e-0fb1-4207-92a4-1b114d77c5fa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.711625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c85e-0fb1-4207-92a4-1b114d77c5fa None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.714034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 364/768] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:02.714959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c85e-0fb1-4207-92a4-1b114d77c5fa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.728973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7d8d-d3d6-448b-9d2f-167f5ca33811 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.771627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.773129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.774035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.774521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.785261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.787525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-c47bc680-2f07-423f-aed4-845dbbca5bc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:02.802252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:02.803173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:02.804043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:02.811098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 405/769] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:02.811098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.811098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.811098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.829506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:02.830702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:02.864139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c85e-0fb1-4207-92a4-1b114d77c5fa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.908768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 406/770] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:02.909877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.910840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.911681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.912143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.912639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.913475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] RBAC: Adding query filter params (type=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.913945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.915487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.917583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.934582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 365/771] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:02.936814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.005787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.040965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed996e-b9a9-4c30-915d-a60a61d02e4f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.060203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab654c-c9cb-463a-bac7-25aedf4aef21 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.081417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.082149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.082780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.082971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.083756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:03.084155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.085891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.104717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 407/772] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:03.104717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.109057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.111608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.112125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.112663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.127094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:03.134282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:03.135307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:03.136141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:03.142632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 366/773] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:03.142632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.216635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.223764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c61fa-3e91-4105-ad29-1edbfa6d8e8c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.257147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.264540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.265379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.265497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa73a6f-26dd-4442-a22d-08154979d719 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.265898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.266308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.267312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] RBAC: Adding query filter params (interface=public, service_id=be734f55d6984d95a966b7a9298f6fef, region_id=RegionOne) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:03.268585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.270096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.281087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 408/774] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/endpoints?service_id=be734f55d6984d95a966b7a9298f6fef&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:03.282175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.301081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc7c1-2f02-4987-bdf1-664ca113318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.301745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc7c1-2f02-4987-bdf1-664ca113318b None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.302028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc7c1-2f02-4987-bdf1-664ca113318b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.302301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc7c1-2f02-4987-bdf1-664ca113318b None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/099e4db05ff34c9bad67022f4484c108/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.304192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc7c1-2f02-4987-bdf1-664ca113318b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=099e4db05ff34c9bad67022f4484c108, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.305655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc7c1-2f02-4987-bdf1-664ca113318b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.319900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 367/775] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:03 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/099e4db05ff34c9bad67022f4484c108/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:03.325948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40a0c9-b07b-4040-8b41-61681c1157b3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.326235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40a0c9-b07b-4040-8b41-61681c1157b3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.326510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40a0c9-b07b-4040-8b41-61681c1157b3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.327992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 368/776] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:03.328527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40a0c9-b07b-4040-8b41-61681c1157b3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.428930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b330a-004b-4a53-92f8-68dd9c8ebd2f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.468867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40a0c9-b07b-4040-8b41-61681c1157b3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.484752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.485732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.486308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.486589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.487655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:03.487977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.489459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564e26-1811-4129-8500-072efc5a17d1 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.495240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.500136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 409/777] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:03.501513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.501793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.502068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.512817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.513696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.514221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.514669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.515457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.517075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.528589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 369/778] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:03.528783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:03.528868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.528941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:03.605280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.651111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 410/779] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:03.663741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0ba8-08db-4c84-99e7-0d5d73addec3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.689350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.711660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.712301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.712602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.713853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.729404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.730951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:03.746453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:03.747434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:03.748544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:03.748544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:03.748544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:03.748544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 370/780] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:03.757476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.820049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c6b5d-b98c-44ae-b75e-5673f2713e09 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.839629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.863475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.864111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.864387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.864731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.865319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.868370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:03.883537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:03.884683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:03.886164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:03.889307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 411/781] 10.222.0.25 () {56 vars in 1129 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:03.897865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.949572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c57a7b-76c1-4d38-a354-df4f3b6575c5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.959937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.988840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.989912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.990407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.990854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.991783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:03.992337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.993902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db5cc5-92d6-43da-9cf1-6998a1fb2ded None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.007489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 371/782] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.009360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f969c1-1594-403e-bd40-7a5de2bb1bcd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.010437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f969c1-1594-403e-bd40-7a5de2bb1bcd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.010911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f969c1-1594-403e-bd40-7a5de2bb1bcd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.012413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 372/783] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:04.016467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414678b3-5fd5-477d-a48d-ee42448f6f45 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.017504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f969c1-1594-403e-bd40-7a5de2bb1bcd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.053653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.054271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.054619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.054983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.055687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.056061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.058202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e346341-6942-41a2-aad7-f2d2b100a70f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.067417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 412/784] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:04.068792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.069151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.069500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.089331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:04.091051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:04.124605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.133337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f969c1-1594-403e-bd40-7a5de2bb1bcd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.176154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 413/785] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:04.176154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.177869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.178809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.179262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.179707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.189993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.191678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:04.216593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.217623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:04.218561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:04.220592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.222024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 373/786] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.226337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.285000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af3b3-905a-4106-962a-1a6229ea0658 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.323546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.324083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.324356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.324652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.325281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.325581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.327058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.332620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 414/787] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.333539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.337480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7735-95f6-427b-b1c9-acd2b0073d44 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.374568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.375445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.375895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.376311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.387786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:04.393516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.394635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:04.395623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:04.403545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 374/788] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.404589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.421470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.444490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a1fd-6b06-4563-ad38-bf919e963d3f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.456759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.482964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.483566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.483841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.484114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.484879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.485183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.486601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.511068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 415/789] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.512073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.515546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672ae45-0b5f-4880-909a-27f5858d4eac None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.552662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.553532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.553954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.554368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.555263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] RBAC: Adding query filter params (interface=public, service_id=35b70d3f31ba43959ff59e0cdbc2368a, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.555716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.558013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.566592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 375/790] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/endpoints?service_id=35b70d3f31ba43959ff59e0cdbc2368a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.567833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.622560 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820a9cf-2dae-4388-bf83-1e1b773ff492 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.656411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.669078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.670602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.671343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.671799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.672981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.674046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.676431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.686965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86ecd-56e5-49ef-9c40-34c31a5f70c8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.694279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 416/791] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.694279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.728913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.731852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.732606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.732895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.733160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.746024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.747747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:04.763003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.763995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:04.764935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:04.764935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:04.764935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:04.768805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 376/792] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.769756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.826531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198d8d-277d-4044-9e3a-5176a7584942 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.874070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.874600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.874881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.875158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.875763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.877168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.884273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 417/793] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.886019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.892606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e9054-1e35-4b2b-95d7-3237a8e18e6b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.925631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.941800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.942516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.942795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.946483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.971913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.973424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:05.006164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:05.007187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:05.008093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:05.008093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:05.008093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:05.008093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 377/794] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:05.014880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.080855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.092411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6dd3-040e-42d8-b698-cfc25b102e3b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.144996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.145749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.145934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.146225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.147091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.147311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.148856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.156899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1657-25aa-4118-83bd-8e32fa607043 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.163516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 418/795] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:05.170869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.203259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.203905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.204186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.204581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.205171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.205472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.206926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.220233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 378/796] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:05.225803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.292767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.340092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1631e-caa6-4467-b7c9-354a92238ecf None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.412863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd6b34-d4be-434a-8595-ce23673737e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.424304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.425342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.425846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.426341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.441311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.444618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:05.470442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:05.471394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:05.472288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:05.478012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 419/797] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:05.488198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.499782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.500786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.501273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.501764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.518133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.518433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.520039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:05.546455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:05.547550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:05.548494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:05.551716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 379/798] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:05.557574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.627492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432ef5-d87f-4f8c-9208-68bd2a1737ea None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.667360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.668292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.668856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.669447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.670355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.670864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.672801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eed56-a1c0-4ea0-a592-871759654244 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.686496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 420/799] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:05.688191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beda9e-904f-4a37-a636-1af8204507cd None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.688727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beda9e-904f-4a37-a636-1af8204507cd None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.689221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beda9e-904f-4a37-a636-1af8204507cd None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.690884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 421/800] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:05.693198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beda9e-904f-4a37-a636-1af8204507cd None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.719556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b524bd3-4b0a-47f8-8a9a-ac6a51f0bc89 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.721156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.755789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.756397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.756696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.757006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.757688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.757989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.759403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51901e-9d5d-4e5f-8300-57765de73c86 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.783865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 380/801] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:05.783865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5c8d-1eab-45a3-aaf1-f01b9c1dd82c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.783865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5c8d-1eab-45a3-aaf1-f01b9c1dd82c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.783865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5c8d-1eab-45a3-aaf1-f01b9c1dd82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.785353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.811499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beda9e-904f-4a37-a636-1af8204507cd None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.811837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-512d5c8d-1eab-45a3-aaf1-f01b9c1dd82c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:05.813083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-512d5c8d-1eab-45a3-aaf1-f01b9c1dd82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:05.851331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.851988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.852265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.852536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/52b6f0f0ede94e629574bc502166e36b/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.869719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=52b6f0f0ede94e629574bc502166e36b, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.871112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.892616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 381/802] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:05.892616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d35c-aac3-4960-be39-9528e408efe0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.892616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d35c-aac3-4960-be39-9528e408efe0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.892989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 422/803] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:05 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/52b6f0f0ede94e629574bc502166e36b/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:08:05.892989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.893122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d35c-aac3-4960-be39-9528e408efe0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.894622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 382/804] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:05.908101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.908460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.908740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.932524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:05.933435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:06.020764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 383/805] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:06.021896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.055062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.063299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93207210-4556-4bfb-8361-d7cb1b0453f4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.100673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.116053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.116945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.117326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.117658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.137131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.138585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.154134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64bcfb-3a67-4bea-b61b-4d777bba0970 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:06.160421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.161377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:06.162300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:06.162300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.162300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:06.162300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 423/806] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.167805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.198782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.199759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.200306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.200819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.212057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:06.217813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.218776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:06.219635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:06.222117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 384/807] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.223125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.311552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeba84f-f50f-4f4f-9fc0-6f7e51410178 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.316460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.339120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebc7a-333c-4df3-8e4d-cc89fe0cb05a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.360652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.361529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.361955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.362919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] PATH_INFO: `/v3/services/network` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.363898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.365735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.377555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.378776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:06.379747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:06.380474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.380474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.380474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.380474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.380852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.380852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.381164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.382763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 424/808] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.384262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.398934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 385/809] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.399788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.440264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.514194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7201-6e1f-4c99-94e5-a28b4f332039 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.522024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d036-9c28-4e4e-86d6-22fa82d4d195 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.554074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.554694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.554977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.555302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.555934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] RBAC: Adding query filter params (name=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.556440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.557912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.562784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 386/810] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.563657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.566764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.568528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.569205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.569760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.570178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.571036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.571508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.573864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.589796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 425/811] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.589796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.683201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817c9c-45e2-41f4-ad99-e4cc68b5d235 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.729696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccbcbe-25c5-4ec8-a110-f11b061817f4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.731390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.732836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.733622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.733735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.734006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.741487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.743209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:06.754965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.755908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:06.756807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:06.760820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 387/812] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.761672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.778368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.779765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.780507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.781014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.782102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] RBAC: Adding query filter params (type=network) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.783062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.784720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.791448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 426/813] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.792524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.839703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.892578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef2d73-7d87-4594-a18e-9a9aa208f962 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.913607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f27fb-5f7f-4f05-8e63-07d203b79f05 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.936215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.936968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.937338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.937679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.949258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.950864 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.960370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.961261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.961543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.961828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.962518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.962961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.964675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:06.968580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.969492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:06.970391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:06.970391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.970391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:06.977024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 388/814] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.978113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.983908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 427/815] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.984840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.013664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.093409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da651195-bb43-4eb7-9d37-906a4a74ad89 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.095607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d040-6a5a-4f3a-954f-b5dd35b8681d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.114048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.130788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.131466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.131684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.131958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.132639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.132935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.134302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.138080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.138922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.139400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.139899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.140788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.142496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.152432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 428/816] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.152432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.176551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 389/817] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:07.177754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.292957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.300836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7b6e-b727-4aaa-bdcf-838cd345f699 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.320656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4078c-2200-4392-8bd5-98202681b3a9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.342793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0353a1-374a-487c-8c71-afe5ab09ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.343570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0353a1-374a-487c-8c71-afe5ab09ebb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.343787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0353a1-374a-487c-8c71-afe5ab09ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.344053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0353a1-374a-487c-8c71-afe5ab09ebb9 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/eb23346704d74ab8aea1a295ab75cde8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.346810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0353a1-374a-487c-8c71-afe5ab09ebb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=eb23346704d74ab8aea1a295ab75cde8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.348327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0353a1-374a-487c-8c71-afe5ab09ebb9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.363839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.364258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 429/818] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:07 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/eb23346704d74ab8aea1a295ab75cde8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:07.365118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.372648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17223-5df6-4699-9af3-024f33f40c34 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.372648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17223-5df6-4699-9af3-024f33f40c34 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.372648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17223-5df6-4699-9af3-024f33f40c34 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.372648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 430/819] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:07.373040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.373040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.376587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.376587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.376587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.380232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.383353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.395003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:07.396298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:07.398797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:07.399860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:07.401909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:07.402963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 390/820] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:07.408140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.454182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.486003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 431/821] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:07.513354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.555409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f0d45-b2cc-4ce2-8635-81972ad94854 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.599238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.600942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.601389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.601673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.602414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.602740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.604406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.622989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.632230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 391/822] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.632230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.654604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07890-cfbe-49a4-8e48-40510a76b7aa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.698219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.700097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.700097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.700097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.701000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.702552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:07.713128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:07.714167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:07.714999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:07.718142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 432/823] 10.222.0.25 () {56 vars in 1129 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:07.724406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.730193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.746722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961d420-789b-4244-8486-2c790332ab8e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.787169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.787874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.794602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.795197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.841943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8556aff-201e-4e80-8865-ef8e4bc90107 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.873898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.875855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.881761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.882457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.882806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.883148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.883854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.884250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.886613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.896350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 433/824] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.897635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.902367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.985219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.006351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 392/825] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:08.012208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.017879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3d90-d08e-4bff-bdcb-4133485d2447 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.058821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.059812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.060092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.060365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.061328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.061784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.063154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e7fa6-c8cd-461b-b4b6-e83ad85a0eec None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.073930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 434/826] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.073930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f74b-24cf-418d-b84e-dc60ed639825 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.073930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f74b-24cf-418d-b84e-dc60ed639825 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.073930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f74b-24cf-418d-b84e-dc60ed639825 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.076736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 435/827] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:08.077813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f74b-24cf-418d-b84e-dc60ed639825 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.127053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7552b09-5b1c-4959-91c6-7f0e27f8da5f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.147671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.168174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.168833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.169114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.169389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.182268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.183706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.189189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f74b-24cf-418d-b84e-dc60ed639825 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-edb67004-16cf-4684-be50-d877a8fdff38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:08.199432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.200455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:08.201397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:08.201397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.201397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:08.201397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 393/828] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:08.202399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.202399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.202646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.221480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:08.222861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:08.234571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.235174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.235447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.235713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.236356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.237747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.256139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.268588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 436/829] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:08.268588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.318821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 394/830] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:08.344388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.384083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55106-e433-4a00-9f87-145717045954 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.409762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.422492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.423302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.423673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.424042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.424843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.425244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.426731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.444789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 437/831] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.446119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.466028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b059e53-0fa6-4d5c-a7ee-7a516c572368 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.507447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.508140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.508415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.508726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.521542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:08.526772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.527778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:08.528660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 395/832] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:08.534659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.571323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.575296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c585e-7c38-4547-b304-3f17415a176d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.614670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.615644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.616121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.616597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.624203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.625926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:08.638648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.639565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:08.640448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:08.642915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 438/833] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:08.649390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.662156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e49f55-528f-4b16-bb38-c7166129bbd5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.710022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.712380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.713853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.714364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.714899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.716498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.717106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.718835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.728900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 396/834] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.736703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.767936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2afe-6294-4c37-bee8-ed4eecc9251a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.812034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863af660-b667-4890-9a49-f457b54c693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.812684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af660-b667-4890-9a49-f457b54c693a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.812964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af660-b667-4890-9a49-f457b54c693a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.813243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af660-b667-4890-9a49-f457b54c693a None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.813933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863af660-b667-4890-9a49-f457b54c693a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.814238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863af660-b667-4890-9a49-f457b54c693a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.815657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863af660-b667-4890-9a49-f457b54c693a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.832599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 439/835] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.836911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863af660-b667-4890-9a49-f457b54c693a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.839636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.857836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a499852-853b-4984-883c-21c460f356a9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.906009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.906656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.907001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.907338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.921237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.922804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:08.941193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.942373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:08.943481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:08.943481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.943481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:08.944596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 397/836] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:08.949781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.970535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863af660-b667-4890-9a49-f457b54c693a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.973829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.023288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.024519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.026761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.027278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.028212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=099e4db05ff34c9bad67022f4484c108) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.028759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.030400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.039894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 440/837] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/role_assignments?user.id=099e4db05ff34c9bad67022f4484c108&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:09.065887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce03b-4419-4393-bf70-e8478ddd418e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.107121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.107752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.108035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.108312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.109016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.109320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.110731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.119702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.127751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 398/838] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:09.133490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.248141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab8e1f-bb5e-41e1-bca6-585d7e91d2cb None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.285130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.285757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.286031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.286300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.295169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.296710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:09.308450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:09.309437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:09.310381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 441/839] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:09.315556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.424004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1554c-1b6b-461e-8c47-24494d1d1a67 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.460215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.460858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.461136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.461407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.462128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.462431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.464068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87b6ef-ef06-4d3e-af81-e0a1cef77712 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.483078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 399/840] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:09.488643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.495680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d6aba-922f-4123-bc76-6d48a445f0bc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.495965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d6aba-922f-4123-bc76-6d48a445f0bc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.496236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d6aba-922f-4123-bc76-6d48a445f0bc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.497585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 400/841] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:09.504474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.504733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.504978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.525685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:09.527275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:09.528853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.587308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.612950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 401/842] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:09.631295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4357d5-e6c2-4bab-9492-4a2cf89efc68 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.632774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.676502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.677912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.678338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.678764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.746774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fb992-729c-4350-960b-3f83ac33f0c0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.750463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.751930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.781079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.784054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.784989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.785408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.785838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:09.807913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:09.808826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:09.809706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:09.810452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 402/843] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:09.811924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.856300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 442/844] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:09.861589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.873621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.949327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103c60b-33c6-4a16-b4da-f3e3c66b0879 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.971560 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17272-99cd-4485-89f5-4068b354cf3b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.999094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.007007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.007630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.007907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.008175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.008491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.010370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.013773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.014290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.015186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.015698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.019628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.021102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.023637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:10.041310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.042300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:10.043281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:10.043281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.043281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:10.043281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 443/845] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:10.043506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 403/846] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.045379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.047944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.239993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eb953-8af4-4e86-9b58-b393ff363780 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.247666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f61a-d5cf-4c9e-949f-07b2829c2789 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.265918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.296813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.297355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.298390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.299012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.321602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.323769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.332352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.333628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.334803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.335569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.336680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.338393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.343680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:10.353411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.354538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:10.355420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:10.355420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.355420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:10.359925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 444/847] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.361091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.379490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 404/848] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.388520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.437034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.517975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21314d1-f6fb-4e0e-a1d7-fb2aff9600eb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.535852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80770f75-2cd5-4469-9eca-4f6959850056 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.555668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.557225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.557520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.557794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.564496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.565990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.572406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.573038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.573314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.573586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.574225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.574526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.575956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91177-df2a-4e9c-b816-4a6ca207afa6 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2c8c6f19-10d9-480f-9e5b-d0560d941f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:10.578647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.579723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 405/849] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828d28-a506-48d5-a670-b70feeece0f9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.585619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828d28-a506-48d5-a670-b70feeece0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.586360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828d28-a506-48d5-a670-b70feeece0f9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.586360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 406/850] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:10.587407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828d28-a506-48d5-a670-b70feeece0f9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.604233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 445/851] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.604233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.604233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.604233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.617127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.621507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:10.622691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:10.697701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 446/852] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:10.698783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.714459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828d28-a506-48d5-a670-b70feeece0f9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.735381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.751251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.752079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.752506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.752949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.753808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.754259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.755824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.769786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 407/853] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.770772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.831523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190153db-af40-48f1-ad83-2619e7331e09 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.870281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.871815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.872648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.872930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.873226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.881231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.882673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.884048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bb0f-a27b-4913-b962-e7ce02ca20b1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:10.894360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.895297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:10.896303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:10.900174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 447/854] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.901287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.923484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.924896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.925412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.925837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.926570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.928083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.937684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.938741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:10.939674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:10.946490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 408/855] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.947535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.987721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.007454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455e92-c2af-4765-92b7-192450b8fc85 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.044462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.045100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.045377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.045657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.046367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=52b6f0f0ede94e629574bc502166e36b) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.046675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.048098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.054054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 448/856] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/role_assignments?user.id=52b6f0f0ede94e629574bc502166e36b&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.054824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.068947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78b85-5f7a-489b-8d04-0153ceb30515 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.111888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.113336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.116967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.117500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.119665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.120194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.122473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.152845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 409/857] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.156344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.173065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.211535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a801f6-8f92-4f3e-9fef-580547447092 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.256478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.257180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.257393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.257664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.258296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.259157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.259999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee24a-dc27-46b7-97ab-80d5fb7abca7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.264681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 449/858] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.265781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34042378-1319-4515-99ea-ed87d576a1a3 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.266063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34042378-1319-4515-99ea-ed87d576a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.266893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34042378-1319-4515-99ea-ed87d576a1a3 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.272598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 450/859] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:11.272742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34042378-1319-4515-99ea-ed87d576a1a3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.281616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e908d0-b953-45c1-8b96-b14cf1373008 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.287761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.327971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.328884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.329162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.329596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.385013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34042378-1319-4515-99ea-ed87d576a1a3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.406270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.407720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.420046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.423179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.423784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.424054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.424323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.424983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.425280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.426618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d371c3-d460-4201-9cee-7f6ffe8aeb8c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.431643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 451/860] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:11.432734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.433013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.433280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.453782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:11.455011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:11.549084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 452/861] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:11.556075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 410/862] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:11.561800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.566537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.570249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.687837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97075c5d-d833-4e99-8063-24edbd9c4d15 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.700394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198d51-7717-4ada-be20-e0365cd718b6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.712208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.727552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.729226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.729852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.730358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.738447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.738879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.739229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.739582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.740233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.741725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.743367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.745337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:11.751196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:11.752121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:11.753028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:11.756906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 411/863] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:11.758610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:11.764897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:11.765846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:11.766748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:11.766748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:11.766748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:11.768595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 453/864] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:11.773732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.842554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.872281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb724b0-0b3e-49c7-afbe-5a7528bb766b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.890451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835eb26-0a4f-4a00-842b-0b54b5deeb23 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.909194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.910110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.910577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.911034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.911858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.912339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.913933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.923550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 412/865] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:11.924680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.928599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.929188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.929548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.929928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.930630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.930995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.932994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.945697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 454/866] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:11.951077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.968701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.039089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210ad52-897e-40d3-84b8-8298d2424b5d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.070557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357eabd-2cd1-464b-83ef-bf2d642621bc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.075307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.076132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.076556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.077021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.077790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:12.078235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.080207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.085877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 413/867] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:12.094473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.116424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.117584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.118063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.118531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.127632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.129552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:12.143144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:12.144155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:12.145078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:12.147657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 455/868] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:12.154621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.266404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4016d9-cc9f-4898-ad2a-5a539381ad3f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.268188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.303494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.304171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.304450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.304748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.305508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:12.305814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.307708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d9dbf-37ea-40c5-9b56-151df30be73c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.321302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 414/869] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:12.327875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.434950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefa74f-3ca5-4e29-b4b6-ccb7bc59ac69 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.471302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.471901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.472227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.472502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.473294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=eb23346704d74ab8aea1a295ab75cde8) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:12.473606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.475027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a433c-cd3f-472a-a1d2-83f3d915689f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.481906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 456/870] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/role_assignments?user.id=eb23346704d74ab8aea1a295ab75cde8&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:13.216346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c137bd7-a054-4a0c-bcc6-20578568e9e6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.216940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c137bd7-a054-4a0c-bcc6-20578568e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.217216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c137bd7-a054-4a0c-bcc6-20578568e9e6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.218912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 415/871] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:13.224173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896073d9-4de0-4aae-9da3-f249fe0512c7 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.224597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896073d9-4de0-4aae-9da3-f249fe0512c7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.224974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896073d9-4de0-4aae-9da3-f249fe0512c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.248981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-896073d9-4de0-4aae-9da3-f249fe0512c7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:13.250185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-896073d9-4de0-4aae-9da3-f249fe0512c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:13.287959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.325373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 457/872] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:13.347164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c137bd7-a054-4a0c-bcc6-20578568e9e6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.456966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c137bd7-a054-4a0c-bcc6-20578568e9e6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.465859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6fda-4a51-40aa-b9ab-769e8f34ff34 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.466395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6fda-4a51-40aa-b9ab-769e8f34ff34 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.466395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6fda-4a51-40aa-b9ab-769e8f34ff34 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.467983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 458/873] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:13.472652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.472930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.473197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.494169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:13.495395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:13.495992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.496887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.497483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.497967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.509331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:13.515107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:13.516016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:13.516896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:13.519128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 416/874] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:13.525759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.559102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.582873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 459/875] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:13.605306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.653377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd4b07-15a7-4178-b3ef-916e900dd07c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.692688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.693299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.693577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.693850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.694509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:13.694810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.696179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.705620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 417/876] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:13.711937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.733634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.737415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3aa2a-5920-4464-9905-27a5a3e1b0d2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.777678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.778501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.778878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.779254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.780064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.781567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.805331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 460/877] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:13 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:13.825497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.847133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f45336-bccd-4de1-88fc-90d4e416ecf0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.895829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.896471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.896822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.897093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.909763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.911343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:13.927821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:13.928898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:13.929794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:13.929794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:13.929794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:13.934418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 418/878] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:13.935830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.048920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd879-8181-4580-87e7-1d0e5f1d8714 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.084726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.085329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.085600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.085865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.086497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:14.086790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.088409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106bce0-2bc7-44a0-a7dd-a5853ef9ce11 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.101830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 461/879] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:14.107403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.196120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08789c1-e0c2-4692-8b2d-ea35477a1a5c None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.196446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08789c1-e0c2-4692-8b2d-ea35477a1a5c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.196692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08789c1-e0c2-4692-8b2d-ea35477a1a5c None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.198318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 462/880] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:14.203505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.204039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.204512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.221420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c173-1492-4d36-a2bd-608a3489f052 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.224406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:14.225841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:14.241437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.252821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.259608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.260365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.260685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.260972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.270079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.271541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:14.284598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:14.285617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:14.286572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:14.288635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 419/881] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:14.291687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.316766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 463/882] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:14.332599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.403740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb96184-d9f1-4a3b-9c97-bea05f7ae684 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.436614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569640d2-2bc1-45af-9e12-3f40c27c5635 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.445857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.446720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.447323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.447882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.448800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:14.449308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.450888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.470527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 420/883] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:14.476696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.485774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d68902-5203-4406-aa49-1bb2ff7e33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.486459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d68902-5203-4406-aa49-1bb2ff7e33fe None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.486798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d68902-5203-4406-aa49-1bb2ff7e33fe None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.487130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d68902-5203-4406-aa49-1bb2ff7e33fe None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.488349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d68902-5203-4406-aa49-1bb2ff7e33fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.489823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d68902-5203-4406-aa49-1bb2ff7e33fe None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.512596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 464/884] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:14 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:14.562136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.614643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfb361-dbe8-494c-984b-e0b4fa70b9a7 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.614864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfb361-dbe8-494c-984b-e0b4fa70b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.615163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfb361-dbe8-494c-984b-e0b4fa70b9a7 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.616715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 465/885] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:14.622312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.622679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.622905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.624627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f50aa1-d57a-49cb-94d4-65d054227895 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.643001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:14.644366 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:14.648723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.670081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.670759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.671042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.671313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.728067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 466/886] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:14.747217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.748987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.750830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.813391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.867677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66623d0e-26c6-44ce-ba62-b9639924b96f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.893380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 421/887] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:14.894695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.910658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.912338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.912872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.913621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.914640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.916724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:14.930349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:14.931880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:14.932830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:14.938696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 467/888] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:14.941472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.945373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.014244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4d57-98bc-42d8-bf2b-083a97456644 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.053647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27226f1-d379-4ea4-9ea5-7e9bc8a73da2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.054692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.055397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.055724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.055990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.070287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.072045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.081350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:15.092603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:15.093561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:15.094488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:15.094488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:15.094488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:15.096307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 422/889] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:15.101754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.103678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.104280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.104549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.104857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.105491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.105789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.107149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.116861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 468/890] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.118255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.188103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.225906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0fb9-bb27-4b6e-bcca-6d8b216d5fba None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.235781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc486e9-72c7-457e-8f72-84366f560042 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.262173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.263156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.263156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.263444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.264007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.264305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.265732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.277051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 469/891] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.281513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.282487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.282995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.283486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.284349 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.284887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.286537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.306397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 423/892] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:15.308211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.426894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47175ea-8698-41b1-8c15-c58f2e3ec0a4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.460541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.466491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.467121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.467397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.467665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.474608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.476104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:15.489721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:15.491180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:15.492257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:15.494039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 470/893] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:15.501442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.564862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.609140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217360dc-ef0c-4b0b-8d08-47f1c863f97c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.644404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.645058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.645331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.645601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.646292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.646607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.648017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81cb4b-0e53-4d8a-a9f0-ce7d6771d94c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.661504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 424/894] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.667453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.774044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059e67-be9b-4cbd-b2ff-5c6d4ec9ee04 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.818816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.819811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.820288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.820792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.821711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] RBAC: Adding query filter params (role.id=1ab7841a9be84dfea38a28af6b0cd4e5, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=52b6f0f0ede94e629574bc502166e36b) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.822509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.824153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843e62-b8ba-4add-80f4-32db027d550a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.830647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 471/895] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/role_assignments?user.id=52b6f0f0ede94e629574bc502166e36b&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=1ab7841a9be84dfea38a28af6b0cd4e5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.962592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42603b25-8769-4ae4-91d1-3f67249b41e6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.962970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42603b25-8769-4ae4-91d1-3f67249b41e6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.963302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42603b25-8769-4ae4-91d1-3f67249b41e6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.964828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 425/896] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:15.970343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.970619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.970897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.990718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:15.991910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:16.046550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.064593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 472/897] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:16.087196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42603b25-8769-4ae4-91d1-3f67249b41e6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.196088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42603b25-8769-4ae4-91d1-3f67249b41e6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.225160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.232100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.232764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.233043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.233318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.233896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.235263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:16.244851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:16.246256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:16.247272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 426/898] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:16.251922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.357312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d585ba-70d9-4c08-8de9-627b1117ff53 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.394083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.395054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.395565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.396042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.396925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:16.397432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.398988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.404545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 473/899] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:16.409748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.514323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82529d-4341-4af4-afb9-8f4b50bb398c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.553329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.554387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.554948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.555441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.556324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:16.556889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.558467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadfae6-6bbb-4662-a7e1-c89c631f27c7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.564205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 427/900] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:16.569832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.630497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.684669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139d58-49ba-469a-bb7f-095a90b5113d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.715384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb92c6-f2b6-47e1-8f45-85ef99a784c3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.715923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb92c6-f2b6-47e1-8f45-85ef99a784c3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.715923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb92c6-f2b6-47e1-8f45-85ef99a784c3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.718549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 428/901] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:16.721165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.721995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.722465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.722652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.722933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.723204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.723493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.724388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] RBAC: Adding query filter params (interface=public, service_id=f6dee7af840b4805ae0af5930eb081ea, region_id=RegionOne) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:16.724913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.726745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.733862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 474/902] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/endpoints?service_id=f6dee7af840b4805ae0af5930eb081ea&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:16.741297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.742115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:16.743303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:16.798927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.835299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 429/903] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:16.851696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.878270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b047-7a72-4ef5-89f1-96bff523207c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.898118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.927154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.928040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.928325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.928630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.929240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.932549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.948670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 475/904] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/services => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:08:16.967509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf10625-75fc-4243-b370-8242fb1a7a95 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.010598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.011253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.011527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.011796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.012392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.013986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:17.024102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:17.025809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:17.026954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:17.030139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 430/905] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:17.032932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.151162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f5d53-6707-4dec-b88b-d4489b6c3764 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.187330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.187934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.188211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.188482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.189134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.189435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.190788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.198205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 476/906] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.203932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.250329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.311890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024651-f39a-4da0-9737-f96529417c9f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.347233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.347845 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.348119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.348389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.349051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.349351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.350711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a95ce-0234-47c2-8cc4-448ce82662cb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.356221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 431/907] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.363330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.411944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.475683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867257c3-5766-45fa-aefb-48b2d9727ca7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.476292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cb643-28fd-4e39-8877-5646dfbcdab6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.476596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cb643-28fd-4e39-8877-5646dfbcdab6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.476892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cb643-28fd-4e39-8877-5646dfbcdab6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.479022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 432/908] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:17.484369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.484709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.484990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.502963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:17.504167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:17.522876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.523531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.523811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.524082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.524811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] RBAC: Adding query filter params (interface=public, service_id=90da1674a8cb4c7193cab621bc2069f1, region_id=RegionOne) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.525762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.527735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.539898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 477/909] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/endpoints?service_id=90da1674a8cb4c7193cab621bc2069f1&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.542043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.584693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 433/910] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:17.602401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.655574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45661b8f-0d02-4425-8347-e7bb86f2c980 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.663654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.664959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.698113 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867662-e18f-4c2b-b345-e01a794c9452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.698729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867662-e18f-4c2b-b345-e01a794c9452 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.699003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867662-e18f-4c2b-b345-e01a794c9452 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.699274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867662-e18f-4c2b-b345-e01a794c9452 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.699872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867662-e18f-4c2b-b345-e01a794c9452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.701272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867662-e18f-4c2b-b345-e01a794c9452 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.709286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c4e7-86ea-4577-b620-bc4d2af43e39 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.712711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 478/911] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:08:17.750693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ad60-6e9a-46a8-b8c7-2b052102e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.751496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ad60-6e9a-46a8-b8c7-2b052102e387 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.751874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ad60-6e9a-46a8-b8c7-2b052102e387 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.752253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ad60-6e9a-46a8-b8c7-2b052102e387 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.753090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ad60-6e9a-46a8-b8c7-2b052102e387 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.754621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ad60-6e9a-46a8-b8c7-2b052102e387 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.783779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 434/912] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:17 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:17.929967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ebad3-83a8-4696-948a-a0cca8eee3b9 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.930159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ebad3-83a8-4696-948a-a0cca8eee3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.930450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ebad3-83a8-4696-948a-a0cca8eee3b9 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.933077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 479/913] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:17.938846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.939354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.939850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.959472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:17.961058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:18.041324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 435/914] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:18.062939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ebad3-83a8-4696-948a-a0cca8eee3b9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.175808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ebad3-83a8-4696-948a-a0cca8eee3b9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.213138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.213765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.214041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.214309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.225247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:18.230626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:18.231572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:18.232400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 480/915] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:18.237878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.277006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.344237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e0bd6-ffcc-4580-bffc-b2c474725c80 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.378769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.379375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.379647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.379918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.380556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:18.380876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.382299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.391331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 436/916] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:18.397635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.429773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.501722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333db8-a0d4-4c7c-9108-e99d753eadff None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.537520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.538139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.538410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.538676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.549571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.551011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:18.565519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:18.567731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:18.569972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:18.569972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:18.569972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:18.569972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 481/917] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:18.573896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.657460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.675729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f77b1-1c3d-4a76-8a42-935b6d19d49b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.709664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.710265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.710534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.710804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.711434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:18.711730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.713717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.726638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 437/918] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:18.732505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.832150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.853182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa07f-8017-432d-8720-6deb6d71110c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.889165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.889790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.890069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.890340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.898293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.899743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:18.911815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:18.913946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:18.916588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 482/919] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:18.920608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.026704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a117a-0de9-4690-97ac-e900a2d4272d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.062448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.062965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.063240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.063503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.064213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.064511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.065948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4868b45-e1b8-455c-8b9c-b878da81e389 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.080421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.084216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 438/920] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:19.089995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.131923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03278a-2e00-4afb-a2f9-70e0878646c9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.131923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03278a-2e00-4afb-a2f9-70e0878646c9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.131923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03278a-2e00-4afb-a2f9-70e0878646c9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.131923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 439/921] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:19.141755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.141755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.141755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.162331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:19.164032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:19.203245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649c567-fa2e-4930-ad0e-0e16511aff18 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.241461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.242502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.243095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.243889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.248597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 440/922] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:19.261327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.262987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.264915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.271938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:19.280229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:19.281202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:19.282088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:19.282088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:19.282088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:19.282088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 483/923] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:19.288360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.401714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57f94e-a3ca-44c8-ba26-9e502a8c3fb7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.405793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ca19-a6f1-4fe3-b9c5-932438123c4d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.438040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.445317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.445685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.446352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.446728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.447080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.447315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.447658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.447981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.448534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.448844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.449254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.450424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.450799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:19.461295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:19.463073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:19.463975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:19.472589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 441/924] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:19.472809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 484/925] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:19.473063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.478667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.550388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.588669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ab9f-3386-4d80-af9f-ce519659f6ce None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.604112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539d186-af17-40a7-aaec-30959a7c5e29 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.627311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.627887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.628169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.628496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.629153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.629497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.630812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.641545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 442/926] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:19.642565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.650476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.651508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.651839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.652058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.660642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.663019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:19.680745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:19.682555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:19.683448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:19.685807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 485/927] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:19.691378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.724795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.776825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5265-7d7d-40ce-b33c-e32932da46aa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.821497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.822825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.823192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.823553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.824551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.824976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.826912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.836719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 443/928] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:19.839661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.841934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04eb8a8-75b3-406e-b6f7-e2ff744d9219 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.861579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.889281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.889886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.890162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.890446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.891122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.891424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.892873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278338d9-59ac-4e3b-8643-3ea70cf75e44 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.908795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 486/929] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:19.908795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff8b8-3572-4d9e-9b27-d5f558458dc7 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.908795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff8b8-3572-4d9e-9b27-d5f558458dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.908795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff8b8-3572-4d9e-9b27-d5f558458dc7 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.909145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 487/930] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:19.911680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ff8b8-3572-4d9e-9b27-d5f558458dc7 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.954394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39d73-c158-4b9b-88c1-fe050c406643 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.975881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.988690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9eece-d422-456a-865a-88af466e29e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.989287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eece-d422-456a-865a-88af466e29e8 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.989559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eece-d422-456a-865a-88af466e29e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.989826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9eece-d422-456a-865a-88af466e29e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.990469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9eece-d422-456a-865a-88af466e29e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.991823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9eece-d422-456a-865a-88af466e29e8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.011826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 444/931] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:20.013146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.013430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.013703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.028343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ff8b8-3572-4d9e-9b27-d5f558458dc7 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.032660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:20.033912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:20.070967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3176d-5b64-4a12-847b-8fe6d2ee39b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.071765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3176d-5b64-4a12-847b-8fe6d2ee39b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.072059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3176d-5b64-4a12-847b-8fe6d2ee39b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.072326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3176d-5b64-4a12-847b-8fe6d2ee39b5 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/52b6f0f0ede94e629574bc502166e36b/roles/1ab7841a9be84dfea38a28af6b0cd4e5` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.074892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3176d-5b64-4a12-847b-8fe6d2ee39b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=52b6f0f0ede94e629574bc502166e36b, role_id=1ab7841a9be84dfea38a28af6b0cd4e5)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.076356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3176d-5b64-4a12-847b-8fe6d2ee39b5 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.094198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 488/932] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:19 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/52b6f0f0ede94e629574bc502166e36b/roles/1ab7841a9be84dfea38a28af6b0cd4e5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:20.106083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c3099-d73d-4dbb-8135-54b1a55054ec None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.106361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c3099-d73d-4dbb-8135-54b1a55054ec None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.106633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c3099-d73d-4dbb-8135-54b1a55054ec None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.108625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 489/933] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:20.114195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.114486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.114753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.126335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 445/934] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:20.142179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:20.143887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:20.151783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.179699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.237344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 490/935] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:20.261707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.301141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b84b3a-f6b8-4d30-a6e7-bcd465e1c4e5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.311898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.337214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.338664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.338855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.339132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.339719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.341118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:20.350314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:20.351264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:20.352127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 446/936] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:20.358869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.398663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345679e-9d54-4772-a857-e836fac903b2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.446289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.447899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.448364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.448840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.449610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.451715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:20.463278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:20.464306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:20.465170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 491/937] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:20.469825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32874dd-6bd1-497a-9b28-36bdf099897b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.473460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.502079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.511923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.512844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.513318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.513780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.514601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.515119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.516762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.522434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 447/938] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:20.528335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.568986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.586778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6fbcb-98aa-4cf3-a31a-3ebdf9b75e42 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.628360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.629278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.629704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.630120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.630907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.631355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.632909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.639403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 492/939] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:20.645391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.660318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba754b4-3c84-4d12-89d3-1b49d0dc5c69 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.705389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.706723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.707350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.707935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.708976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.709887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.711908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.720443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 448/940] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:20.725647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.749516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.771086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c084-e7fa-4c61-945a-6f9b30470fad None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.820650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.821484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.822373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.822773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.823498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.823899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.825449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.835679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 493/941] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:20.837994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.860906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.865310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe02bc-6bfb-4a8a-8e87-4ce7b1c65e7d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.903573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.904219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.904657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.904956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.905622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.907352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.935942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 449/942] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:20.978290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495702dd-b5e4-45c8-9b93-0309accd5f35 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.027071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.028082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.028552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.029073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.030048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] RBAC: Adding query filter params (interface=public, service_id=74ee0b9c1b4a4603a2f09e78536166b5, region_id=RegionOne) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:21.030550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.032179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04204e1e-bc33-43c4-93ae-39cef1daa6af None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.043592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 494/943] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/endpoints?service_id=74ee0b9c1b4a4603a2f09e78536166b5&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:21.046563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.154709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112d6e-b06b-4167-aaf6-a7919cad4500 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.189715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4839476-5d21-4361-9edd-b3f897d7eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.190558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839476-5d21-4361-9edd-b3f897d7eed5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.190977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839476-5d21-4361-9edd-b3f897d7eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.191391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839476-5d21-4361-9edd-b3f897d7eed5 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.192154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4839476-5d21-4361-9edd-b3f897d7eed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.193684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4839476-5d21-4361-9edd-b3f897d7eed5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.204686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 450/944] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:08:22.143091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96890013-bff1-4fea-a285-fb1a0df688f2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.143588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96890013-bff1-4fea-a285-fb1a0df688f2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.143588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96890013-bff1-4fea-a285-fb1a0df688f2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.145114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 495/945] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:22.151425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.151826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.152009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.170560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:22.171745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:22.186520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.192223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798afe-59d0-4e62-aa20-68f7d58fc5f2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.192550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798afe-59d0-4e62-aa20-68f7d58fc5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.192838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798afe-59d0-4e62-aa20-68f7d58fc5f2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.194284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 496/946] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:22.200252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.200817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.201319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.226398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:22.226398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:22.236755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.264486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 451/947] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:22.287900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.309589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 497/948] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:22.332428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.400719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d4f8-cfdb-4e43-909f-11bd90e35384 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.438396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.438881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.439164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.439436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.440210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.441739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.444371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING keystone.server.flask.common [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 18:08:22.466158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.sql.core [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 18:08:22.466158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 18:08:22.466158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [parameters: {'id': 'dcddb38c385c40a8a5fd6aca348ac78a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 18:08:22.466158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 18:08:22.472448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de25ab-ec5a-4f0b-a804-df83db47e7bf None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcddb38c385c40a8a5fd6aca348ac78a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcddb38c385c40a8a5fd6aca348ac78a. Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:22.476218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 18:08:22.477088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application yield resource Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise self.value Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application session.commit() Aug 07 18:08:22.478130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.flush() Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application compat.raise_( Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 18:08:22.479048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 18:08:22.479948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:22.482099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [parameters: {'id': 'dcddb38c385c40a8a5fd6aca348ac78a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.484543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.486449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcddb38c385c40a8a5fd6aca348ac78a. Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 452/949] 10.222.0.25 () {60 vars in 1140 bytes} [Sun Aug 7 18:08:22 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.489680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.496164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.536679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.537662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.538710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.539168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.554220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:22.561627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.562623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:22.563462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:22.564087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 498/950] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:22.569918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.575207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.627714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba0c08-6065-45a7-9ec5-557c368ab354 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.679771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.680364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.680672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.681453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.690282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.692765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.705236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f740f-72f5-4dfb-880d-ee5477779109 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:22.708730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.709633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:22.710540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:22.718819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 453/951] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.721677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.751671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.752305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.752601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.752892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.753996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.754364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.756102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.783383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 499/952] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:22.784465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.831105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.870601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.871862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe8e44-e77d-49e1-98df-f7f3e1262875 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.912298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.912934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.913255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.913477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.914137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.915223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.917414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.926442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5341f-4803-4610-a7ec-e94ef985dad0 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.944673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 454/953] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:22.972947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.973596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.973928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.974205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.987922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.989489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-1d1e22ac-6c0a-4d1d-803b-f271a820bdf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:23.005859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.006966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:23.007919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:23.007919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:23.007919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.007919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 500/954] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:23.013553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.032777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea1e9-1388-434e-b5ee-51604dca895c None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.033057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea1e9-1388-434e-b5ee-51604dca895c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.033332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea1e9-1388-434e-b5ee-51604dca895c None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.034964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 501/955] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:23.040953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.041230 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.041495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.065841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:23.067519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:23.143895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b134573-d99f-4c0e-bf56-dac370cdff1f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.166944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 502/956] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:23.176396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.186534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.189208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.190670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.190955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.191226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.191879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.192177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.193561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.207540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 455/957] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.213918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.246015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.302707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e0b0-e51d-49b5-a770-e85220fd4c06 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.333534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d5d36-3a12-4a96-8f2a-6e22be829922 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.339646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.340339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.340640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.340911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.341500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.342957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-cf9be3a3-54c6-4450-9f0c-d2da4a1f2f75 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.351928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.353605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.354552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 503/958] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:23.356449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495d1a-f3ed-4587-b6fa-b0c8b52914d5 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.356449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495d1a-f3ed-4587-b6fa-b0c8b52914d5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.356449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495d1a-f3ed-4587-b6fa-b0c8b52914d5 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.357365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 504/959] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:23.362078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da495d1a-f3ed-4587-b6fa-b0c8b52914d5 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.382495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.383356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.383485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.383665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.392250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.393898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c525234d-fb6f-416e-bb0f-3deab71fe7ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:23.406186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.407203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:23.408163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:23.412063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 456/960] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:23.413203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.413485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.413800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.433596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:23.435120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:23.475078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da495d1a-f3ed-4587-b6fa-b0c8b52914d5 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.481735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.487273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.510295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 457/961] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:23.516957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.520535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.521373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.521836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.522689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.523530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.524019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.526640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.533574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 505/962] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.535292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.624613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2b88-2f94-4c59-ba62-37a060307372 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.649057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c54d7-ffa1-4c35-aa06-0c8c92791123 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.661477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.662084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.662368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.662635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.663356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.663658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.665123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.684585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.685297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 458/963] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.685697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.686136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.686239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.686665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.687241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.688662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.699358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.700430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:23.701295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 506/964] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:23.702685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.729823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.745543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.799945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b7b48-a8e7-435b-a238-9947d2c65d52 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.823768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf18148-caf6-470f-8086-bc1dd0a9d061 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.838907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.839508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.839782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.840047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.840707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.841005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.842355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.853105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 459/965] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.855366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.863308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.863936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.864210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.864477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.947421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.949486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.994564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.001469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.007903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ced2c-2a8c-4150-90c7-886dedfa86b6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.051167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.052051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.052478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.052937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.053711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.054650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.057496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.064342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 460/966] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:24.072619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 507/967] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:24.072803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.075116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.182311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310433a0-afd9-4030-b4e2-01e717ce0398 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.200518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292b2f2-f902-4db7-9fa4-18b428e96373 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.227515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.228747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.229025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.229294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.238687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.241934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.243601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.244110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.244236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.244804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.245651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.245766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.246608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.248408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.254417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 461/968] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:24.260002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:24.266357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:24.267673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:24.268854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:24.268854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:24.268854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:24.268854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 508/969] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:24.272527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.302145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.386428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0509b-c68c-44a4-81b1-f366b9521277 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.407921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8fa61-9ead-4435-842b-88f7f3c228d2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.425372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.426364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.426844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.427318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.428282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.428825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.430456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.444549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 509/970] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:24.450816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.455170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.456079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.456649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.457145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.458016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.459596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.485522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 462/971] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:24.522467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.585615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb28918-f0b1-4818-a5bb-e98390ee0652 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.633803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.634772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.635070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.635349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.643007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.644469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:24.658475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:24.659420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:24.660758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 510/972] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:24.665873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.755007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.778427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cf37-1e31-4a2e-8420-dd5f74b021e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.820191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.820926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.821274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.821676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.822519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.822953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.824501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703928a3-902e-4720-a335-d3ccbb506a57 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.838633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 463/973] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:24.844594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.952550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5d428-dad2-4d50-a4d3-8d3661921864 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.960428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.990461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.991064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.991335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.991599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.992308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] RBAC: Adding query filter params (role.id=1ab7841a9be84dfea38a28af6b0cd4e5, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=52b6f0f0ede94e629574bc502166e36b) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.992632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.994123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590fc3-a318-4470-9ab1-fb4859991a77 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.000626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 511/974] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/role_assignments?user.id=52b6f0f0ede94e629574bc502166e36b&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=1ab7841a9be84dfea38a28af6b0cd4e5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:25.127035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f0bbc-a158-4150-b79c-2f2089fd700b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.127337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f0bbc-a158-4150-b79c-2f2089fd700b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.127503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f0bbc-a158-4150-b79c-2f2089fd700b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.129223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 464/975] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:25.135901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.136252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.136634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.156021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:25.157311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:25.228499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 512/976] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:25.252832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f0bbc-a158-4150-b79c-2f2089fd700b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.364517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f0bbc-a158-4150-b79c-2f2089fd700b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.402910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.403436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.403716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.403989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.404668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.406103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.425214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.sql.core [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 18:08:25.425214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 18:08:25.425214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [parameters: {'user_id': '9e06dbba96fe49e1950e991429003ab8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 18:08:25.425214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:25.432413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:25.433350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application yield resource Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise self.value Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application session.commit() Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 18:08:25.434302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.flush() Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application compat.raise_( Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 18:08:25.435205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:25.436105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:25.438297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e06dbba96fe49e1950e991429003ab8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:25.440227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 18:08:25.442128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:25.452301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 465/977] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Aug 7 18:08:25 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:25.453249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.555496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.559217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f835-f29a-4600-bfc7-75b4f3762dd2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.595300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.595922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.596194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.596459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.604260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.605733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-f542f100-8566-4e10-9712-d62f2598c135 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:25.617457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:25.618936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:25.620021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 513/978] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:25.627345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.632940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.740587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e9c0-3d16-4499-810a-47090184acd3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.778965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.779577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.779856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.780130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.780856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:25.781163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.782794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ad9a6-332c-4114-aae7-ff0b05ff4937 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.823529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 466/979] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:25.936803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db3ff-72e3-4716-923b-e46013ad119f None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.937093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db3ff-72e3-4716-923b-e46013ad119f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.937349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db3ff-72e3-4716-923b-e46013ad119f None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.938974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 514/980] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:25.944675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abf978-71ee-4be0-94bf-6a25a272fc81 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.944970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abf978-71ee-4be0-94bf-6a25a272fc81 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.945235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abf978-71ee-4be0-94bf-6a25a272fc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.965347 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-88abf978-71ee-4be0-94bf-6a25a272fc81 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:25.967691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-88abf978-71ee-4be0-94bf-6a25a272fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:26.028121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.039710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 467/981] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:26.062883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db3ff-72e3-4716-923b-e46013ad119f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.170676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db3ff-72e3-4716-923b-e46013ad119f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.203971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83410a8-eaeb-4ace-88fd-fc02548a0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.204584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83410a8-eaeb-4ace-88fd-fc02548a0dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.204867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83410a8-eaeb-4ace-88fd-fc02548a0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.205135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83410a8-eaeb-4ace-88fd-fc02548a0dc7 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.205779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83410a8-eaeb-4ace-88fd-fc02548a0dc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.207129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83410a8-eaeb-4ace-88fd-fc02548a0dc7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.228593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 515/982] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:26 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:26.675731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f510e-a024-40c5-aeea-19448828ff15 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.676249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f510e-a024-40c5-aeea-19448828ff15 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.676249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f510e-a024-40c5-aeea-19448828ff15 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.677780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 468/983] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:26.683085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.683368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.683646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.702764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:26.703948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:26.719803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.782002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 516/984] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:26.804550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f510e-a024-40c5-aeea-19448828ff15 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.910718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f510e-a024-40c5-aeea-19448828ff15 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.945662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.946223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.946519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.946856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.947754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.949146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:26.957735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:26.958716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:26.965208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 469/985] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:26.967869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.070815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fba07b-62e9-4fbb-b879-8206563d8b43 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.104698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.105298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.105568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.105833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.106441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.106736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.108078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbef6a-4ebb-4760-ab10-7679104e35f3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.112959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 517/986] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:27.119419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.174955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a383-b2ed-4911-80e8-a0b4b7c1d532 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.175260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a383-b2ed-4911-80e8-a0b4b7c1d532 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.175502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a383-b2ed-4911-80e8-a0b4b7c1d532 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.176853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 518/987] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:27.178249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.182361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.182642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.182914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.201019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:27.202134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:27.205832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.230183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc498-51c1-4917-9d40-ec34bd414f3a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.264178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.264815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.265094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.265368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.265989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.266289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.267645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.272909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 470/988] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:27.278906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.280881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 519/989] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:27.295154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.389893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b012-c83f-4286-b6e6-4850868b1e38 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.407207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de461-a22f-4b27-9cae-25637f430722 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.411483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.426728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.427314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.427589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.427856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.428549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] RBAC: Adding query filter params (interface=admin, service_id=74ee0b9c1b4a4603a2f09e78536166b5, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.428877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.430255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.436001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 471/990] 10.222.0.25 () {56 vars in 1249 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/endpoints?service_id=74ee0b9c1b4a4603a2f09e78536166b5&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:27.441195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.449702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.450336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.450614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.450885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] PATH_INFO: `/v3/services/image` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.451516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.452866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:27.461553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:27.462639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:27.468768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 520/991] 10.222.0.25 () {56 vars in 1105 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:27.469572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.472769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.553526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c740c-41e5-4dd5-b97e-a84b5ea5da35 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.576751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad19c-6219-474e-adaf-02464a917d4a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.592045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.592795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.593137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.593475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.594153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.595583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.602237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 472/992] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:08:27.612406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.613233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.613510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.613777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.614415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] RBAC: Adding query filter params (name=image) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.614713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.616114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad959a6-0225-4160-8c15-57eb3b703856 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.627521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 521/993] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:27.628596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.683977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.741116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9468f-1e47-4fb2-9fa6-acb8c9cc75b7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.778823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.779435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.779777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.780055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.780789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.781101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.782462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692962-0551-481e-84f4-d9ef4c3ff1b8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.787559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 473/994] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:28.260895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161936a0-59c3-455d-91b2-bab817e4af7d None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.261321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161936a0-59c3-455d-91b2-bab817e4af7d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.261428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161936a0-59c3-455d-91b2-bab817e4af7d None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.262811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 522/995] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:28.267833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.268125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.268395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.286722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:28.287921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:28.355965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 474/996] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:28.378290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161936a0-59c3-455d-91b2-bab817e4af7d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.449671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.485881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161936a0-59c3-455d-91b2-bab817e4af7d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.519783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.520333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.520641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.520916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.521491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.522852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:28.532664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:28.533654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:28.539593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 523/997] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:28.542616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.585620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.643676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1064-e2ee-4bbb-a25b-f868f3303732 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.676958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.677561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.677834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.678099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.678713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.679009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.680358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.690297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 475/998] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:28.691328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.799405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8f355-749a-4389-bbe4-0d02bc70766d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.833996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.840335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.840958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.841229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.841494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.842114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.842407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.843745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.848794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 524/999] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:28.855614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.963559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62c04f-3e39-4515-81fa-919d61c22dbc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.971670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:29.000304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:29.000932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.001210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.001481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.002169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] RBAC: Adding query filter params (interface=public, service_id=87744afb3e4b4c8fa92e4f93215dff31, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:29.002474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:29.003833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d3dfb-bce2-45a7-b7da-b8c4f83c5958 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:29.009496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 476/1000] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/endpoints?service_id=87744afb3e4b4c8fa92e4f93215dff31&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:29.014827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:29.115073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846fa6a-b195-4613-854a-c992beb39813 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:29.149509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b52f-8527-4eca-abed-35d94081a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:29.150734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b52f-8527-4eca-abed-35d94081a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.151043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b52f-8527-4eca-abed-35d94081a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.151575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b52f-8527-4eca-abed-35d94081a7e7 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.152170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b52f-8527-4eca-abed-35d94081a7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:29.153558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b52f-8527-4eca-abed-35d94081a7e7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:29.164645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 525/1001] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:29 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:08:29.627019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff845-a2ac-43d0-9c59-19b6a3068207 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.627433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff845-a2ac-43d0-9c59-19b6a3068207 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.627551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff845-a2ac-43d0-9c59-19b6a3068207 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.629062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 477/1002] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:29.634091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18bae-74f4-4486-bf94-3f1ffcf5809d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.634755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18bae-74f4-4486-bf94-3f1ffcf5809d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.634755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18bae-74f4-4486-bf94-3f1ffcf5809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.652797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-84d18bae-74f4-4486-bf94-3f1ffcf5809d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:29.653976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-84d18bae-74f4-4486-bf94-3f1ffcf5809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:29.712878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:29.725307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 526/1003] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:29.748210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff845-a2ac-43d0-9c59-19b6a3068207 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:29.795649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42babe-f09a-4c94-9149-dbd756055f60 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.795933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42babe-f09a-4c94-9149-dbd756055f60 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.796204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42babe-f09a-4c94-9149-dbd756055f60 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.797752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 527/1004] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:29.802569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.802569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.802863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.821353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:29.823050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:29.865068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff845-a2ac-43d0-9c59-19b6a3068207 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:29.892357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 528/1005] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:29.902116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:29.902973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.903427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.903871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.904670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:29.906197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:29.914876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:29.915915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:29.917014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:29.917860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:29.921630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 478/1006] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:29.923856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:29.960896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:30.017175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0372ed-b170-4dca-9599-380170c8d59d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:30.034534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ccdd4-3f25-4314-94e9-cfd444e97037 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:30.039434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:30.055544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:30.056989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.057340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.057825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.058462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:30.059863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:30.071710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:30.072308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.072747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.073139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.073757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:30.074056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:30.075393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:30.084812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 529/1007] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:29 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:30.085014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 479/1008] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:30.086345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:30.206838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7a145-a05b-427e-bbee-dbcb9744ccc4 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:30.244092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:30.244737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.245007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.245274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.245900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:30.246197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:30.247551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2b388-0602-4fa8-b029-2e3df5c855f2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:30.253009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 530/1009] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:30.258605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:30.360529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:30.365321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbcd4-8690-4cbd-9ecb-482ea407c6e2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:30.400577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd822565-c920-4bd7-9516-379e1eb94188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:30.401446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822565-c920-4bd7-9516-379e1eb94188 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.401724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822565-c920-4bd7-9516-379e1eb94188 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.401993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822565-c920-4bd7-9516-379e1eb94188 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.402660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd822565-c920-4bd7-9516-379e1eb94188 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:30.404020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd822565-c920-4bd7-9516-379e1eb94188 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:30.428599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 480/1010] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:31.203530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee8be-3b69-40ba-84b0-804806449473 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.204037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee8be-3b69-40ba-84b0-804806449473 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.204037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee8be-3b69-40ba-84b0-804806449473 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.205569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 531/1011] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:31.211093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.211586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.211661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.230156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:31.231353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:31.305872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 481/1012] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:31 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:31.328548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccee8be-3b69-40ba-84b0-804806449473 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.372881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.434728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccee8be-3b69-40ba-84b0-804806449473 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.468014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.468673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.468954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.469225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.469800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.471156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:31.479922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:31.480942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:31.481807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:31.484881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 532/1013] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:31.486901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.575791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.593371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fdf8e-1884-4e4a-9b06-5510213bf86f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.627773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.628378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.628682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.628957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.629582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:31.629884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.631247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.640793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 482/1014] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:31.642317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.747385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5256b2-018c-46ed-8d44-711ebe2596d1 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.749664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.783187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.783841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.784170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.784447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.785206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:31.785509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.786870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0805a-4392-4d29-87d2-ac3bfa5b02d2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.800414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 533/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:31.801744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.904281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393525-dc4b-4086-9ec7-b5bf0fd27285 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.939421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912fec5-173a-4d23-81b9-0ff301a7ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.940346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912fec5-173a-4d23-81b9-0ff301a7ef64 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.940840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912fec5-173a-4d23-81b9-0ff301a7ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.941292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912fec5-173a-4d23-81b9-0ff301a7ef64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.942123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912fec5-173a-4d23-81b9-0ff301a7ef64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.943671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912fec5-173a-4d23-81b9-0ff301a7ef64 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.972985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 483/1016] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:32.125188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01c98-8849-4e32-a7cc-773242783bb5 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.125370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01c98-8849-4e32-a7cc-773242783bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.125659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01c98-8849-4e32-a7cc-773242783bb5 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.126996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 534/1017] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:32.132302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.132674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.132955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.141010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.154570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:32.155793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:32.230719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 484/1018] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:32.253559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01c98-8849-4e32-a7cc-773242783bb5 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.358481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01c98-8849-4e32-a7cc-773242783bb5 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.394591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.395139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.395415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.395683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.396256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.397653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d6a47665-0c82-4031-b775-a83fe25689ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:32.406790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:32.407801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:32.413685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 535/1019] 10.222.0.25 () {56 vars in 1105 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:32.416520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.436981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742f213-028f-4cd8-a364-c16c1dce2995 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.437286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742f213-028f-4cd8-a364-c16c1dce2995 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.437518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742f213-028f-4cd8-a364-c16c1dce2995 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.438954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 536/1020] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:32.443534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.443811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.444083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.462623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:32.463993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:32.495309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.525482 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0ada-ccf6-4184-a447-cd08e4f0f468 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.541419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 537/1021] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:32.556258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.563312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.563801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.564011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.564124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.564344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.565012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] RBAC: Adding query filter params (name=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.565319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.567822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.574468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 485/1022] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.580021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.672078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0df95-1e81-4d50-b263-12cea68dfcc8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.687374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73760990-7a6f-4bef-83b5-b6a4ca3a1271 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.710334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.711249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.711531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.712006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.713745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.715178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.716931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 538/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.722278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.723109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.723713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.723987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.724254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.724902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] RBAC: Adding query filter params (type=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.725198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.726542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.736521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 486/1024] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.737660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.765598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.809241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.845471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71510eb-76a6-445c-b5ae-b2914edf6215 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.855458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b5f98-81b6-4281-be0d-a17a6698135a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.882287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22bc6-c85a-4728-9ad1-0d10feec12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.882903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22bc6-c85a-4728-9ad1-0d10feec12fc None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.883170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22bc6-c85a-4728-9ad1-0d10feec12fc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.883439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22bc6-c85a-4728-9ad1-0d10feec12fc None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.884821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e22bc6-c85a-4728-9ad1-0d10feec12fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.886508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e22bc6-c85a-4728-9ad1-0d10feec12fc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.898629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.899228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.899505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.899826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.900481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] RBAC: Adding query filter params (interface=public, service_id=4b85e64f075542039df4829b72bd02c3, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.900811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.902420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.908187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 487/1025] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/endpoints?service_id=4b85e64f075542039df4829b72bd02c3&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.913354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.919095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 539/1026] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:32 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:33.034011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00627-6be0-4385-a7c6-ccdc4172c9f3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:33.059683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:33.073662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b48d29-5824-4aa4-8388-7879825d631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:33.074328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b48d29-5824-4aa4-8388-7879825d631c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.074609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b48d29-5824-4aa4-8388-7879825d631c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.074875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b48d29-5824-4aa4-8388-7879825d631c None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.075484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b48d29-5824-4aa4-8388-7879825d631c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:33.077005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b48d29-5824-4aa4-8388-7879825d631c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:33.083874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 488/1027] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:08:34.124006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bfb36-8c71-4642-a0de-52d09c5d9e18 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.124512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bfb36-8c71-4642-a0de-52d09c5d9e18 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.124512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bfb36-8c71-4642-a0de-52d09c5d9e18 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.125857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 540/1028] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:34.130817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.131213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.131381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.149803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:34.150991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:34.222522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 489/1029] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:34.246723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bfb36-8c71-4642-a0de-52d09c5d9e18 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:34.333081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:34.354801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bfb36-8c71-4642-a0de-52d09c5d9e18 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.389385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.389955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.390226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.390489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.401431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:34.406009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:34.406958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:34.412837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 541/1030] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:34.415554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:34.517928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7dd14-1721-4b50-a83f-6a23ebf57907 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.534758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:34.553940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.554546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.554825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.555094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.556287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:34.556700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:34.558064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:34.570796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 490/1031] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:34.572738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:34.674491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2de961-eafb-4c20-8e41-705058946f02 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.708536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.709348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.709624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.709890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.720631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:34.722058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:34.723769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:34.738037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:34.739016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:34.739915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:34.739915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:34.739915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:34.744642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 542/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:34.745854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:34.857626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381fcc3-da99-4bb9-bb87-1e59e2f8f1e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.891583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.892196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.892474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.892776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.893472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:34.893779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:34.895269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008463-7d9b-4597-b446-2e8ca7f5bd71 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:34.908130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 491/1033] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:34.913657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.002850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc70af-3d55-477d-bfd9-ff4d2c5b047f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.003216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc70af-3d55-477d-bfd9-ff4d2c5b047f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.003400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc70af-3d55-477d-bfd9-ff4d2c5b047f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.004776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 492/1034] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:35.010546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61689b5-ed69-4664-afa5-8a5f2fa92a6a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.010829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61689b5-ed69-4664-afa5-8a5f2fa92a6a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.011101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61689b5-ed69-4664-afa5-8a5f2fa92a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.017764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42afb01-6b69-4faf-bbad-d2d51aaa86d8 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.030466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d61689b5-ed69-4664-afa5-8a5f2fa92a6a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:35.031775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d61689b5-ed69-4664-afa5-8a5f2fa92a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:35.052981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.053618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.053899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.054172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.062320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.063806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.064090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:35.076765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:35.077803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:35.078730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:35.080885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 543/1035] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:35.083530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.107831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 493/1036] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:35.113950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb204417-991d-45ca-870c-0414e4806595 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.114287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb204417-991d-45ca-870c-0414e4806595 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.114561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb204417-991d-45ca-870c-0414e4806595 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.115964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 494/1037] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:35.121285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.121564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.121835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.139344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:35.140534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:35.141559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.188507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ef00-8055-4341-a2b6-206c7f905042 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.207618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 495/1038] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:35.208442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.229278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.230177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.230462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.230789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.231551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:35.231849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.233313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.250944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 544/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:35.251747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.309137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.312857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f1059-b5c3-4764-8042-0b45df2bf103 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.347654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.348280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.348584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.348857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.349966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.351396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.351997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13d95b-289b-4642-b5e3-5068a1c8d39b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.358017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 496/1040] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:35.358017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.365679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.387794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.388413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.388720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.388989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] PATH_INFO: `/v3/services/image` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.389561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.390905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:35.399944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:35.401435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:35.402422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:35.406582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 545/1041] 10.222.0.25 () {56 vars in 1105 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:35.407388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.454728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d68c-76bc-417c-8554-70d0b93b8dbc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.487723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.488317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.488645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.488923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.504990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82e305-b852-4390-a50f-d906edc5435d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.523614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.538042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.538630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.538967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.539236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.539889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.542409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.559222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.560608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.563612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 546/1042] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:35.564404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.601891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.680674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 497/1043] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:35.685665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.694719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300958-8747-4b20-b78c-44dba71d59fd None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.739292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.739902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.740177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.740446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.741190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] RBAC: Adding query filter params (name=image) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:35.741490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.742853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.748172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 547/1044] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:35.753987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.761133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.807065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc85d7-f81b-41ba-9cf6-70023f2a7a3d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.843368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.843917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.844191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.844460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.854842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.856286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.866271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:35.871384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:35.872362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:35.878374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:35.878374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:35.878374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:35.878374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 498/1045] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:35.878374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.879581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604098c-0273-4abe-aed4-1fc23e1f3caa None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.916947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.917545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.917817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.918084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.918701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] RBAC: Adding query filter params (type=image) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:35.918999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.920382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.930118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 548/1046] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:35.932997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.993475 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c139f2-7906-43da-aedc-23c73269a347 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.012390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.032307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.032938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.033232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.033491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.034124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:36.034437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.035778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.041611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d8d1-dfba-4335-bf7e-e556577ae07a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.048639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 499/1047] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:36.054254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.086786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.087984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.088263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.088532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.089396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.091571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.124676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 549/1048] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:36.164685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf0c0-8844-4d68-a793-6f1d19542718 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.213736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.214382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.214659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.214930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.222507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.224041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:36.237001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:36.238024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:36.244175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 500/1049] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:36.246461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.266844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.358536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f4488-8ed7-4c70-a1d8-f7470940fe55 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.394844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.395389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.395668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.395938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.396668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:36.396958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.398388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280182fd-183d-4242-b290-991e5c739bb8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.416611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 550/1050] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:36.419194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.454975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.523922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3869540-c3dd-4735-b219-5407a3c20fce None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.558149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.558753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.559030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.559300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.560016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] RBAC: Adding query filter params (role.id=1ab7841a9be84dfea38a28af6b0cd4e5, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=099e4db05ff34c9bad67022f4484c108) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:36.560327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.561769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbfe67-7293-4065-a90b-edecb9656a57 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.576604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 501/1051] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/role_assignments?user.id=099e4db05ff34c9bad67022f4484c108&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=1ab7841a9be84dfea38a28af6b0cd4e5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:37.639855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786944d-e016-43a7-805b-f8bdb7cc16c3 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.640377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786944d-e016-43a7-805b-f8bdb7cc16c3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.640377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786944d-e016-43a7-805b-f8bdb7cc16c3 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.641806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 551/1052] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:37.646853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.647243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.647423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.667534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:37.668797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:37.738006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 502/1053] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:37.761888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786944d-e016-43a7-805b-f8bdb7cc16c3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.854809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.879876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786944d-e016-43a7-805b-f8bdb7cc16c3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.915760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.916264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.916545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.916842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.927158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:37.931907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:37.932875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:37.933772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:37.936894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 552/1054] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:37.939070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.967167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.041881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4fe01-1e2d-44a7-b9ef-48e759ee33a0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.076311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.076949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.077227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.077504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.078161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:38.078464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.079825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fd407-a950-40b9-a3e3-7c24f4a4634a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.088867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 503/1055] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:38.094380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.169096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abf44-a9f1-4353-908f-6ac0af6ac718 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.169411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abf44-a9f1-4353-908f-6ac0af6ac718 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.169596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abf44-a9f1-4353-908f-6ac0af6ac718 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.171045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 504/1056] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:38.175921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.176210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.176487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.195875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:38.198095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:38.199715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dca9f8-4fe1-489a-b786-93af4a850e1e None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.238734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.239367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.239647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.239920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] PATH_INFO: `/v3/users/90617fa336dd41f992d705b2425cbf03` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.244491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.257288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] RBAC: Authorizing `identity:get_user(user_id=90617fa336dd41f992d705b2425cbf03)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.258885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.260899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 553/1057] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/users/90617fa336dd41f992d705b2425cbf03 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:38.266051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.277989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 505/1058] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:38.299732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.321414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.379217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cbe5b-a671-405e-b537-f34634d30918 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.409699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866758-2ca0-4784-b042-ed07079059ce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.417805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b445dd-c965-4fdf-b9f2-a030ab938860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.418170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b445dd-c965-4fdf-b9f2-a030ab938860 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.418448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b445dd-c965-4fdf-b9f2-a030ab938860 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.418720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b445dd-c965-4fdf-b9f2-a030ab938860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.448035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae92a-215e-42c5-9d39-fae66c716fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.448578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae92a-215e-42c5-9d39-fae66c716fcf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.448864 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae92a-215e-42c5-9d39-fae66c716fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.449131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae92a-215e-42c5-9d39-fae66c716fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.490978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.500256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b445dd-c965-4fdf-b9f2-a030ab938860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.501992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b445dd-c965-4fdf-b9f2-a030ab938860 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.520546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae92a-215e-42c5-9d39-fae66c716fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.522247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae92a-215e-42c5-9d39-fae66c716fcf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.544362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.607146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 554/1059] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:38.608322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1d97-767d-47a1-a4af-99c4982441e8 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.608640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1d97-767d-47a1-a4af-99c4982441e8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.608901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1d97-767d-47a1-a4af-99c4982441e8 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.613941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 555/1060] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:38.613941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1d97-767d-47a1-a4af-99c4982441e8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.629917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 506/1061] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:38.629917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.629917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.629917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.644863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:38.646055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:38.706667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.713091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 507/1062] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:38.713915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.715019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1d97-767d-47a1-a4af-99c4982441e8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.755117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.755731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.756001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.756267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.757385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] RBAC: Authorizing `identity:get_project(project_id=9287a8bb6416464cb34a1faab562cafd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.759322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.760957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 556/1063] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:38.761699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.776852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.828978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af286-ab80-44dd-9e1e-05cb828d4d06 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.862991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.863611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.863886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.864153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.864805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b27f-0bad-47ea-8baf-5f62713760fc None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.874629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.876058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:38.890093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:38.891131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:38.892117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:38.892117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:38.892117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:38.892117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 508/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:38.892117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.904089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.904749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.905032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.905303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.916257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:38.920961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:38.921929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:38.922769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 557/1065] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:38.923467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.947468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.997175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c658f-70d0-461c-a631-a8a177ae377c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.998983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:39.021762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e87b-7de8-4810-99c5-fba6f0ecec76 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:39.031776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.032379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.032700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.032982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.033689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=9287a8bb6416464cb34a1faab562cafd, user.id=90617fa336dd41f992d705b2425cbf03) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:39.033996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.035422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.041474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 509/1066] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/role_assignments?user.id=90617fa336dd41f992d705b2425cbf03&scope.project.id=9287a8bb6416464cb34a1faab562cafd&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:39.042045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:39.072577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.073228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.073913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.074189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.075142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:39.075451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.077734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.092199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 558/1067] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:39.159894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257208-c464-4106-96b7-13a8478e8861 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:39.200304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.200957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.201238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.201513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.202209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:39.202490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.204134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.215665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 510/1068] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:39.221832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:39.315090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:39.334484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599894-b01d-4468-abf1-645f4de1d0ae None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:39.375475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.376107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.376382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.376692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.387694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.389269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:39.404461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:39.405504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:39.406409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:39.406409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:39.406409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:39.406409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 559/1069] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:39.411356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:39.439185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:39.508361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4354d8b-3157-486f-9401-d22ca7f16afd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:39.541912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.542509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.542781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.543047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.543667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:39.543960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.545334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.556191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 511/1070] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:39.561764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:39.658388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b7691-b1dc-4190-9af1-941a613ac191 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:39.691215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.691826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.692101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.692365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.694237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:39.701340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.702906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:39.714433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:39.715877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:39.716863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 560/1071] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:39.721272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:39.808865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:39.821544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf52db-6d38-4c0a-b11e-b8acbebba3fa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:39.855590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:39.856187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.856464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.856765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.857477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:39.857778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:39.859180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:39.875758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 512/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:39.881343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:39.980871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215d2e4-15f6-48a8-88c0-914033ad1310 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.014355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.014971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.015250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.015523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.026040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.027725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:40.042167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:40.043215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:40.044103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:40.044103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:40.044103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:40.044103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 561/1073] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:40.048875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.148318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac1ef-df69-439f-a43f-1d3d9fc51f8d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.183720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.184321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.184615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.184885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.185505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.185801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.187147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.198033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 513/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:40.203540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.250225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.302938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842c75-fe2b-4294-9f1f-a09afbc22272 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.336316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.337519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.337907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.338098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.344508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.345963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:40.357072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:40.358106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:40.359198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:40.360868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 562/1075] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:40.364263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.373852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.461738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30e51-3d7d-40b5-b7dc-ebad47beac01 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.495052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.495641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.495920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.496193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.496906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.497211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.498626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16e37-f865-450f-a6b7-6d2983b862da None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.510537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 514/1076] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:40.516157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.615630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3afde7-4d7e-47be-8e9b-1c4b66777538 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.622468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.649220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefbf39-db1f-4f83-b1d3-3c7d54fde9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.650456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefbf39-db1f-4f83-b1d3-3c7d54fde9d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.650658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefbf39-db1f-4f83-b1d3-3c7d54fde9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.650927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefbf39-db1f-4f83-b1d3-3c7d54fde9d8 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/099e4db05ff34c9bad67022f4484c108/roles/1ab7841a9be84dfea38a28af6b0cd4e5` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.653343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefbf39-db1f-4f83-b1d3-3c7d54fde9d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=099e4db05ff34c9bad67022f4484c108, role_id=1ab7841a9be84dfea38a28af6b0cd4e5)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.654767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefbf39-db1f-4f83-b1d3-3c7d54fde9d8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.668226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 563/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:40 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/099e4db05ff34c9bad67022f4484c108/roles/1ab7841a9be84dfea38a28af6b0cd4e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:41.040422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573387c7-b913-4d46-ba2c-716a05aae676 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.041038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573387c7-b913-4d46-ba2c-716a05aae676 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.041038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573387c7-b913-4d46-ba2c-716a05aae676 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.042376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 515/1078] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:41.047682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.048081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.048172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.066638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:41.067819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:41.142149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 564/1079] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:41.163648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573387c7-b913-4d46-ba2c-716a05aae676 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.229352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.263971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573387c7-b913-4d46-ba2c-716a05aae676 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.298436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.298981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.299252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.299517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.309677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:41.314268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:41.315348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:41.316645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 516/1080] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:41.321330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.414949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.422243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5692c8c-9956-422f-b3ab-7f097fe255c2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.456954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.457552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.457826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.458095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.458741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:41.459041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.460477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.468881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 565/1081] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:41.474692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.576370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fbfc9-4574-44e4-b880-78c4b7df2f7e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.600774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.610074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.610702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.610980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.611251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] PATH_INFO: `/v3/users/90617fa336dd41f992d705b2425cbf03` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.612364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] RBAC: Authorizing `identity:get_user(user_id=90617fa336dd41f992d705b2425cbf03)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.613823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.615411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 517/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/users/90617fa336dd41f992d705b2425cbf03 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:41.621044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.719611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb5b10-80cd-4953-9b64-33f5849b451a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.752306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66d1a-de62-4998-bec0-3abaa45fabf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.752953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66d1a-de62-4998-bec0-3abaa45fabf3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.753225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66d1a-de62-4998-bec0-3abaa45fabf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.753489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66d1a-de62-4998-bec0-3abaa45fabf3 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.754575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66d1a-de62-4998-bec0-3abaa45fabf3 None admin] RBAC: Authorizing `identity:get_project(project_id=9287a8bb6416464cb34a1faab562cafd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.755996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66d1a-de62-4998-bec0-3abaa45fabf3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.757636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 566/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:41.764636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.864391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243482-0884-4922-8247-7aeeb1fa3b75 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.897197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e4cb-27b9-4b92-9c72-b65bca6e1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.897842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e4cb-27b9-4b92-9c72-b65bca6e1f55 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.898117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e4cb-27b9-4b92-9c72-b65bca6e1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.898387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e4cb-27b9-4b92-9c72-b65bca6e1f55 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd/users/90617fa336dd41f992d705b2425cbf03/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.900418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e4cb-27b9-4b92-9c72-b65bca6e1f55 None admin] RBAC: Authorizing `identity:create_grant(project_id=9287a8bb6416464cb34a1faab562cafd, user_id=90617fa336dd41f992d705b2425cbf03, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.902128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e4cb-27b9-4b92-9c72-b65bca6e1f55 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.914662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 518/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:41 2022] PUT /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd/users/90617fa336dd41f992d705b2425cbf03/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:42.677332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d1fed-775a-4871-b3cf-bd1858960cc0 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.677896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d1fed-775a-4871-b3cf-bd1858960cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.677896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d1fed-775a-4871-b3cf-bd1858960cc0 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.679179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 567/1085] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:42.684909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.685290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.685458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.703738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:42.704961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:42.752936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:42.771834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 519/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:42.794984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d1fed-775a-4871-b3cf-bd1858960cc0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.823818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:42.897864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d1fed-775a-4871-b3cf-bd1858960cc0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.930326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.931612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.931732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.931996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.942327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:42.947823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:42.948804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:42.949682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 568/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:42.954878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.054898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40568-955f-4641-bc7d-e52a14b67aa5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.089134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.089731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.090012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.090283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.090938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:43.091241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.092628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.100290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 520/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:43.106568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.191649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.206752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addd387-bf39-4287-a8b5-2b895c4e3aff None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.240059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.240712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.240991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.241260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.252007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.253457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:43.267185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:43.268329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:43.269253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:43.269253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:43.269253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:43.269253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 569/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:43.274021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.322445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.377768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099d391-4789-418d-8d96-3f0e8846d24e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.412200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.412829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.413107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.413374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.414004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:43.414301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.416176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.427673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 521/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:43.433774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.536274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773c13e-e3f0-492d-86cd-e5cef374921d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.569739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.570353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.570624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.570890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.578727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.580165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.581905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:43.593370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:43.594345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:43.595289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 570/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:43.600219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.697310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6ea7-8dbd-4e58-b35e-8c11675d7106 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.704664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.733120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.733725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.734005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.734276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.734996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:43.735301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.736742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fdc44-bcfc-4fcc-9a46-5c5244bfa096 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.753762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 522/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:43.760023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.864483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812de04-9cc2-4349-bfa0-0dbb0d26cc05 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.897902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.898494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.898767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.899033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.902609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a705-5991-47d7-880d-1cb4fe2f1235 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.902891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a705-5991-47d7-880d-1cb4fe2f1235 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.903160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8a705-5991-47d7-880d-1cb4fe2f1235 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.904518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 523/1093] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:43.909309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.909587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.909858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.926969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:43.928141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:43.966190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.969730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.971735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.995586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 524/1094] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:44.018857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.070196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 571/1095] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:44.076332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.110824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.118697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc8e6b-af0e-4582-83d5-6ddf48665763 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.152958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.153589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.153866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.154260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.164023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:44.169635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:44.169762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:44.170737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:08:44.171570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 525/1096] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:44.175835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8e56-31ca-41f8-ad3a-82a0513c5ccb None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.177084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.210377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.210999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.211274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.211545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.222020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.223454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:44.238166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:44.239186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:44.240370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:44.240370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:44.240370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:44.240370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 572/1097] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:44.244921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.275126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed5415-dc08-4298-b962-3da9b59eb4f4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.309389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.309995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.310272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.310544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.311202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:44.311503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.312904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.320783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 526/1098] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:44.326490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.344157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c9f3-5dcf-4f11-9372-9031a3616184 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.344973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.379160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.379756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.380036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.380311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.380968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:44.381266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.382626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.394403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 573/1099] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:44.400640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.412170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.433259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc527-250f-4ddb-a727-bb81a04a1571 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.466992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.467613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.467956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.468233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] PATH_INFO: `/v3/users/90617fa336dd41f992d705b2425cbf03` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.469418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] RBAC: Authorizing `identity:get_user(user_id=90617fa336dd41f992d705b2425cbf03)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.470842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.472418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 527/1100] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/users/90617fa336dd41f992d705b2425cbf03 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:44.478622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.502925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce727e-bfda-4569-841a-44e324dcbd1b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.537307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.537917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.538187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.538457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.545478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.546946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:44.557750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:44.558847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:08:44.559949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 574/1101] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:44.564194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.564535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.580931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b2a7f-76d8-4e84-b283-38f523ccb45c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.614096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.614795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.615074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.615344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.633342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.664576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe594-e5ea-4980-bc35-93a8f579099a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.683551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.685023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.699534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.700132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.700408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.700710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.701391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:44.701700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.703102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.714582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 575/1102] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:44.720592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.770711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.787469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 528/1103] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:44.794293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:44.824300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80f97-cce6-4cec-938f-ade310affe02 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.853682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:44.859802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.860393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.860696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.860968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.861672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] RBAC: Adding query filter params (role.id=1ab7841a9be84dfea38a28af6b0cd4e5, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=099e4db05ff34c9bad67022f4484c108) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:44.861970 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.863432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.869632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 576/1104] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/role_assignments?user.id=099e4db05ff34c9bad67022f4484c108&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=1ab7841a9be84dfea38a28af6b0cd4e5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:44.898522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dca6d-4568-46ea-bab7-7797361c5ffb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:44.936687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829da7-986f-4569-93b6-6c9024d978d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:44.937335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829da7-986f-4569-93b6-6c9024d978d1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.937614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829da7-986f-4569-93b6-6c9024d978d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.937890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829da7-986f-4569-93b6-6c9024d978d1 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.939049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39829da7-986f-4569-93b6-6c9024d978d1 None admin] RBAC: Authorizing `identity:get_project(project_id=9287a8bb6416464cb34a1faab562cafd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:44.940502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39829da7-986f-4569-93b6-6c9024d978d1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:44.942226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 529/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:44.949300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.061138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59ff1-f225-413c-aae4-b66b7fdcd4cb None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.095627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.096215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.096487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.096785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.097491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=9287a8bb6416464cb34a1faab562cafd, user.id=90617fa336dd41f992d705b2425cbf03) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:45.097788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.099193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d595640-4bbe-4d54-ad62-8b733c546913 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.105386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 577/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:44 2022] GET /identity/v3/role_assignments?user.id=90617fa336dd41f992d705b2425cbf03&scope.project.id=9287a8bb6416464cb34a1faab562cafd&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:47.251582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a701-6ce4-4188-94a5-bfed4274e81a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.252108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a701-6ce4-4188-94a5-bfed4274e81a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.252108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a701-6ce4-4188-94a5-bfed4274e81a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.253488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 530/1107] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:47.258542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.258934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.259117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.277754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:47.278923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:47.330309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:47.343703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 578/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:47.367378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a701-6ce4-4188-94a5-bfed4274e81a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:47.424432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:47.470911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a701-6ce4-4188-94a5-bfed4274e81a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:47.503640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4cd7f-c555-40b2-b771-b7b3c2544a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:47.504189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4cd7f-c555-40b2-b771-b7b3c2544a5f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.504462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4cd7f-c555-40b2-b771-b7b3c2544a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.504754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4cd7f-c555-40b2-b771-b7b3c2544a5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.505840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4cd7f-c555-40b2-b771-b7b3c2544a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:47.507263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4cd7f-c555-40b2-b771-b7b3c2544a5f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:47.509023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 531/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:47.514759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:47.609960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4eea-0bd0-402e-9879-724f6a9df901 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:47.642860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c564b1f-6233-436d-989f-8239c83973a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:47.643449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c564b1f-6233-436d-989f-8239c83973a4 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.643719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c564b1f-6233-436d-989f-8239c83973a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.643984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c564b1f-6233-436d-989f-8239c83973a4 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.644647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c564b1f-6233-436d-989f-8239c83973a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:47.646057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c564b1f-6233-436d-989f-8239c83973a4 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:47.667099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 579/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:08:47 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:49.704053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99dc84-13e2-4488-98bc-f79537aacebf None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.704613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99dc84-13e2-4488-98bc-f79537aacebf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.704613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99dc84-13e2-4488-98bc-f79537aacebf None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.705936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 532/1111] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:49.710953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.711344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.711501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.730402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:49.731569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:49.769882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:49.798128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 580/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:49.821814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99dc84-13e2-4488-98bc-f79537aacebf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:49.921857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99dc84-13e2-4488-98bc-f79537aacebf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:49.941153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:49.955063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:49.955611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.955884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.956152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] PATH_INFO: `/v3/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.957519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] RBAC: Authorizing `identity:get_role(role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:49.958867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:49.960157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 533/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:49 2022] GET /identity/v3/roles/709c5429fa39482fa0cd40f9104ce17d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:49.966048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.062343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbd2d1-1f45-43c2-bc25-a60f7f095737 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.095104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.095712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.095988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.096259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] PATH_INFO: `/v3/users/960d9643992e4bdf87a120c68fda9d58` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.109365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] RBAC: Authorizing `identity:get_user(user_id=960d9643992e4bdf87a120c68fda9d58)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.110791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.112346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 581/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:49 2022] GET /identity/v3/users/960d9643992e4bdf87a120c68fda9d58 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:50.118044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.213720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819499-5dd5-4330-80cd-2bee99bf0e99 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.246415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.246998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.247270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.247536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.299725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:50.311952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.313398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.408324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 534/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:50.414251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.445038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:50.513602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9095f-b6b9-4e32-ba27-a311b8a13a87 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.547043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a729b1-25d6-456c-b8b8-ea1dc9b672d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.547656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a729b1-25d6-456c-b8b8-ea1dc9b672d3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.547934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a729b1-25d6-456c-b8b8-ea1dc9b672d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.548206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a729b1-25d6-456c-b8b8-ea1dc9b672d3 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.549326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a729b1-25d6-456c-b8b8-ea1dc9b672d3 None admin] RBAC: Authorizing `identity:get_project(project_id=9287a8bb6416464cb34a1faab562cafd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.550757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a729b1-25d6-456c-b8b8-ea1dc9b672d3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.552734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 582/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:50.559033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.641788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:50.654336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f5fe-d9f0-4f2f-9c7a-b772256443c2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.686244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.686826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.687097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.687362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.688062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] RBAC: Adding query filter params (role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=9287a8bb6416464cb34a1faab562cafd, user.id=960d9643992e4bdf87a120c68fda9d58) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:50.688359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.689800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de12d2-8b8d-4c30-93dc-953d98653d22 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.694865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 535/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/role_assignments?user.id=960d9643992e4bdf87a120c68fda9d58&scope.project.id=9287a8bb6416464cb34a1faab562cafd&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:52.644184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ce19-8632-44a1-94a2-08c8c23b7c61 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.644737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ce19-8632-44a1-94a2-08c8c23b7c61 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.644737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ce19-8632-44a1-94a2-08c8c23b7c61 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.646067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 583/1118] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:52.652195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.652638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.652772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.670903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:52.672095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:52.736107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 536/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:52.757454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898ce19-8632-44a1-94a2-08c8c23b7c61 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.853365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:52.857218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898ce19-8632-44a1-94a2-08c8c23b7c61 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:52.890134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:52.890742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.891015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.891282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] PATH_INFO: `/v3/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.892667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] RBAC: Authorizing `identity:get_role(role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:52.894029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:52.895356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 584/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/roles/709c5429fa39482fa0cd40f9104ce17d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:52.901964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.981286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:52.999447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8893-d375-4e42-96f6-ff07fdb257e4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.034232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.034887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.035165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.035437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] PATH_INFO: `/v3/users/960d9643992e4bdf87a120c68fda9d58` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.036539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] RBAC: Authorizing `identity:get_user(user_id=960d9643992e4bdf87a120c68fda9d58)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.038000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.039580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 537/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/users/960d9643992e4bdf87a120c68fda9d58 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:53.045619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.142249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637f467-fd62-408a-85fb-672fa71429db None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.174436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1ff78-4a13-450b-9c5f-c4f685a2d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.174978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ff78-4a13-450b-9c5f-c4f685a2d330 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.175247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ff78-4a13-450b-9c5f-c4f685a2d330 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.175512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ff78-4a13-450b-9c5f-c4f685a2d330 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.176606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1ff78-4a13-450b-9c5f-c4f685a2d330 None admin] RBAC: Authorizing `identity:get_project(project_id=9287a8bb6416464cb34a1faab562cafd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.178012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1ff78-4a13-450b-9c5f-c4f685a2d330 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.179651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 585/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:53 2022] GET /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:53.186149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.281526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907dad-d9b6-43fb-ba1d-d04181a3bf7d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.314142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a4f2e-30d8-450b-a8a8-86e2d0dc9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.314778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a4f2e-30d8-450b-a8a8-86e2d0dc9091 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.315055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a4f2e-30d8-450b-a8a8-86e2d0dc9091 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.315328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a4f2e-30d8-450b-a8a8-86e2d0dc9091 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd/users/960d9643992e4bdf87a120c68fda9d58/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.317452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a4f2e-30d8-450b-a8a8-86e2d0dc9091 None admin] RBAC: Authorizing `identity:create_grant(project_id=9287a8bb6416464cb34a1faab562cafd, user_id=960d9643992e4bdf87a120c68fda9d58, role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.318878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a4f2e-30d8-450b-a8a8-86e2d0dc9091 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.331816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 538/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:53 2022] PUT /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd/users/960d9643992e4bdf87a120c68fda9d58/roles/709c5429fa39482fa0cd40f9104ce17d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:55.313520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257e2d5-326a-49c1-8d0f-8677c951cafa None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.314124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257e2d5-326a-49c1-8d0f-8677c951cafa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.314124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257e2d5-326a-49c1-8d0f-8677c951cafa None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.315410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 586/1124] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:55.320395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.321375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.321479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.340040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:55.341236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:55.343912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:55.406591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 539/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:55.430602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257e2d5-326a-49c1-8d0f-8677c951cafa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.466292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:55.530982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257e2d5-326a-49c1-8d0f-8677c951cafa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.565573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.566117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.566389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.566656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] PATH_INFO: `/v3/roles/709c5429fa39482fa0cd40f9104ce17d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.568011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] RBAC: Authorizing `identity:get_role(role_id=709c5429fa39482fa0cd40f9104ce17d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.569408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:55.570689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 587/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/roles/709c5429fa39482fa0cd40f9104ce17d => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:55.577092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.672318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6b951-886d-4bb1-83aa-e308853fe82a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.705284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.705891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.706163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.706424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] PATH_INFO: `/v3/users/960d9643992e4bdf87a120c68fda9d58` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.707511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] RBAC: Authorizing `identity:get_user(user_id=960d9643992e4bdf87a120c68fda9d58)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.708944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:55.710487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 540/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/users/960d9643992e4bdf87a120c68fda9d58 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:55.716306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.814406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416074c-2e9a-4293-9c99-44f1f7cb1326 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.816818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:55.847832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.848422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.848726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.848996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.914026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.916010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.009545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 588/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:56.015423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.025957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.113024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e8ee-506f-4ec8-8122-44a385168982 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.144447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b08740-e9cb-4fab-90b0-8a96fde8c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.145080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b08740-e9cb-4fab-90b0-8a96fde8c140 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.145353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b08740-e9cb-4fab-90b0-8a96fde8c140 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.145622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b08740-e9cb-4fab-90b0-8a96fde8c140 None admin] PATH_INFO: `/v3/projects/9287a8bb6416464cb34a1faab562cafd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.146697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b08740-e9cb-4fab-90b0-8a96fde8c140 None admin] RBAC: Authorizing `identity:get_project(project_id=9287a8bb6416464cb34a1faab562cafd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.148104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b08740-e9cb-4fab-90b0-8a96fde8c140 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.150279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 541/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/projects/9287a8bb6416464cb34a1faab562cafd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:56.156534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.159566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.252725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f6cb8-26f7-4fe5-9bd1-3d8af2bf8fec None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.285648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.286227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.286501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.286770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.287474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] RBAC: Adding query filter params (role.id=709c5429fa39482fa0cd40f9104ce17d, scope.project.id=9287a8bb6416464cb34a1faab562cafd, user.id=960d9643992e4bdf87a120c68fda9d58) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:56.287781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.289224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5cd09-f4a8-4dd5-a64f-f8be19836736 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.295292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 589/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/role_assignments?user.id=960d9643992e4bdf87a120c68fda9d58&scope.project.id=9287a8bb6416464cb34a1faab562cafd&role.id=709c5429fa39482fa0cd40f9104ce17d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:58.303882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5134c-1b36-4199-8082-ab2771b3e4c5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:58.304429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5134c-1b36-4199-8082-ab2771b3e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:58.304429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5134c-1b36-4199-8082-ab2771b3e4c5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:58.306368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 542/1131] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:58.311587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:58.311984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:58.312121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:58.330138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:58.331314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:58.394591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:58.401024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 590/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:58.424299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5134c-1b36-4199-8082-ab2771b3e4c5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:58.500168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:58.523181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5134c-1b36-4199-8082-ab2771b3e4c5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:58.556635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4e0e-cfcb-43d1-96c5-994eddfec985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:58.557204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4e0e-cfcb-43d1-96c5-994eddfec985 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:58.557484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4e0e-cfcb-43d1-96c5-994eddfec985 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:58.557754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4e0e-cfcb-43d1-96c5-994eddfec985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:58.558847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4e0e-cfcb-43d1-96c5-994eddfec985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:58.560259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4e0e-cfcb-43d1-96c5-994eddfec985 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:58.561837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 543/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:58.567535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:58.663439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89259d-abb9-41ff-a884-d24d2e006861 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:58.696702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8873b4-0a9e-4341-b54e-e91913652910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:58.697292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8873b4-0a9e-4341-b54e-e91913652910 None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:58.697570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8873b4-0a9e-4341-b54e-e91913652910 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:58.697842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8873b4-0a9e-4341-b54e-e91913652910 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:58.698476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8873b4-0a9e-4341-b54e-e91913652910 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:58.699914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8873b4-0a9e-4341-b54e-e91913652910 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:58.725463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 591/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:58 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:00.728086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd44e5-923e-464c-9123-4e27bdabc949 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.728671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd44e5-923e-464c-9123-4e27bdabc949 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.728671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd44e5-923e-464c-9123-4e27bdabc949 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.729980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 544/1135] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:00.735228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.735664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.735763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.754584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:00.755746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:00.800282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.823111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 592/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:00.846443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd44e5-923e-464c-9123-4e27bdabc949 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.943313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd44e5-923e-464c-9123-4e27bdabc949 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.975568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d01d8-c51c-418e-80be-8796a369feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.976175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d01d8-c51c-418e-80be-8796a369feb1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.976446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d01d8-c51c-418e-80be-8796a369feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.976743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d01d8-c51c-418e-80be-8796a369feb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.978572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d01d8-c51c-418e-80be-8796a369feb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.979928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d01d8-c51c-418e-80be-8796a369feb1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.981480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 545/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:00.987117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:01.089010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03efb2-066b-4829-80ce-4493e1f86878 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:01.121938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9596af-4fe3-4fb4-9cdb-189d8853d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:01.122549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9596af-4fe3-4fb4-9cdb-189d8853d05c None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:01.122820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9596af-4fe3-4fb4-9cdb-189d8853d05c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:01.123085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9596af-4fe3-4fb4-9cdb-189d8853d05c None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:01.123720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9596af-4fe3-4fb4-9cdb-189d8853d05c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:01.125187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9596af-4fe3-4fb4-9cdb-189d8853d05c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:01.145212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 593/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:09:00 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:09:03.187138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4bb3a-8c0f-479f-af55-df0d2a2ec4ac None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.187658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4bb3a-8c0f-479f-af55-df0d2a2ec4ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.187658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4bb3a-8c0f-479f-af55-df0d2a2ec4ac None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.188970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 546/1139] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:03.193977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.194384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.194519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.213907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:03.215072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:03.242931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:03.295082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 594/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:03.317813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4bb3a-8c0f-479f-af55-df0d2a2ec4ac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:03.332759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:03.418951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4bb3a-8c0f-479f-af55-df0d2a2ec4ac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:03.451060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:03.451606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.451876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.452141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.462288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:03.466827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:03.467984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:09:03.469258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 547/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:03.474132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:03.571712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51613a7-a7f9-4aaf-98d8-338dd840cd5d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:03.604936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:03.605526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.605800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.606067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.606717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:03.607015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:03.608363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:03.616128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 595/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:03.622299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:03.689569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:03.718060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69099d4e-0124-43ce-9296-f7c597998602 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:03.750725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:03.751334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.751606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.751873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] PATH_INFO: `/v3/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.765244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] RBAC: Authorizing `identity:get_user(user_id=466cd2dddc7f4b4ca2af4d0a33bfd0a9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:03.766657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:03.768216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 548/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:03 2022] GET /identity/v3/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:03.774052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:03.802422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:03.873132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc8c5-2d76-498e-a66b-4a72d17db93c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:03.905893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:03.906481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.906752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.907019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.971628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:03.973012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:03.999432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:04.069416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 596/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:04.076128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:04.171386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ddb7-a69c-4c8b-82b8-1424975d694d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:04.198946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:04.205326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8e2b3-bfaa-4bb8-bd66-76354c709ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:04.205937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8e2b3-bfaa-4bb8-bd66-76354c709ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:04.206210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8e2b3-bfaa-4bb8-bd66-76354c709ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:04.206478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8e2b3-bfaa-4bb8-bd66-76354c709ae5 None admin] PATH_INFO: `/v3/projects/d678abd51f46479981b5d8e4d153cfa7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:04.207550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8e2b3-bfaa-4bb8-bd66-76354c709ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=d678abd51f46479981b5d8e4d153cfa7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:04.208999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8e2b3-bfaa-4bb8-bd66-76354c709ae5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:04.210595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 549/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:04 2022] GET /identity/v3/projects/d678abd51f46479981b5d8e4d153cfa7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:04.216656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:04.315242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945283-9827-436d-b94e-6d26c1e43b9a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:04.340663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:04.348220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:04.348835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:04.349107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:04.349371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:04.350072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=d678abd51f46479981b5d8e4d153cfa7, user.id=466cd2dddc7f4b4ca2af4d0a33bfd0a9) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:04.350371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:04.351772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fa9c8-48c4-4389-9b0f-3877a302e197 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:04.357587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 597/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:04 2022] GET /identity/v3/role_assignments?user.id=466cd2dddc7f4b4ca2af4d0a33bfd0a9&scope.project.id=d678abd51f46479981b5d8e4d153cfa7&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:06.312022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63432-2a41-4b63-a573-010fa09e2235 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.312625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63432-2a41-4b63-a573-010fa09e2235 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.312848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63432-2a41-4b63-a573-010fa09e2235 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.314244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 550/1147] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:06.319671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.320094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.320200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.338279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:06.339460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:06.421872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 598/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:09:06.445201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c63432-2a41-4b63-a573-010fa09e2235 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.548163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c63432-2a41-4b63-a573-010fa09e2235 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.584306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.584961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.585240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.585550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.597371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:06.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:06.604048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:09:06.609483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 551/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:06.610620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.708223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e9ae-e364-4040-a6fb-7e0c8fca7048 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.731753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:06.743761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.744353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.744651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.744923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.745576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:06.745876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:06.747232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:06.755036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 599/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:06.760966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.818911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:06.859948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15cc13-cb86-417d-a337-cda9ab5770b6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.892753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.893369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.893647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.893919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] PATH_INFO: `/v3/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.895042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] RBAC: Authorizing `identity:get_user(user_id=466cd2dddc7f4b4ca2af4d0a33bfd0a9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:06.896460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:06.898069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 552/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:06.904731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:07.001500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0316e-7c5b-4a1b-af1b-d9de14c4d555 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:07.035448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6263ff-638c-45c0-8de8-d052e1e919d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:07.036050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6263ff-638c-45c0-8de8-d052e1e919d9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:07.036323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6263ff-638c-45c0-8de8-d052e1e919d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:07.036614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6263ff-638c-45c0-8de8-d052e1e919d9 None admin] PATH_INFO: `/v3/projects/d678abd51f46479981b5d8e4d153cfa7` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:07.037697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6263ff-638c-45c0-8de8-d052e1e919d9 None admin] RBAC: Authorizing `identity:get_project(project_id=d678abd51f46479981b5d8e4d153cfa7)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:07.039109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6263ff-638c-45c0-8de8-d052e1e919d9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:07.040719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 600/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/projects/d678abd51f46479981b5d8e4d153cfa7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:07.046594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:07.150525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd11f74-f56f-47ff-a6a8-36ddc510eb76 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:07.175862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:07.184495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70a91d-253a-49a9-a41d-0cad45dff9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:07.185168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a91d-253a-49a9-a41d-0cad45dff9a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:07.185443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a91d-253a-49a9-a41d-0cad45dff9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:07.185712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70a91d-253a-49a9-a41d-0cad45dff9a7 None admin] PATH_INFO: `/v3/projects/d678abd51f46479981b5d8e4d153cfa7/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:07.187559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70a91d-253a-49a9-a41d-0cad45dff9a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d678abd51f46479981b5d8e4d153cfa7, user_id=466cd2dddc7f4b4ca2af4d0a33bfd0a9, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:07.189023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70a91d-253a-49a9-a41d-0cad45dff9a7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:07.201626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 553/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:09:07 2022] PUT /identity/v3/projects/d678abd51f46479981b5d8e4d153cfa7/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:09:09.175696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5491f-b53e-460e-93ad-78a6bf782cae None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.176217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5491f-b53e-460e-93ad-78a6bf782cae None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.176217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5491f-b53e-460e-93ad-78a6bf782cae None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.177520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 601/1154] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:09.182801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.183185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.183339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.201903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:09.203072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:09.268351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 554/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:09.292074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5491f-b53e-460e-93ad-78a6bf782cae None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.346095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:09.395508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5491f-b53e-460e-93ad-78a6bf782cae None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.429162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.429716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.430094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.430710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.440861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:09.445482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:09.447186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:09:09.448142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 602/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:09.453614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.548516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91dbb-a61c-464d-b766-41ac676ba0c1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.564371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:09.583200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.583791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.584069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.584341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.585025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:09.585329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:09.587272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:09.595052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 555/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:09.600780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.699265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7763179-c05d-495a-8842-827ad3075bf0 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.711389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:09.732167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.732805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.733082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.733349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] PATH_INFO: `/v3/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.734450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] RBAC: Authorizing `identity:get_user(user_id=466cd2dddc7f4b4ca2af4d0a33bfd0a9)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:09.735899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:09.737490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 603/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:09 2022] GET /identity/v3/users/466cd2dddc7f4b4ca2af4d0a33bfd0a9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:09.744001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.840640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd459e-2f29-497c-b474-3217d1cbebb3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.872900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.873489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.873765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.874034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.917575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:09.938955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:09.940381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:10.033546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 556/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:10.039902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:10.136527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0731f-c75f-4316-9709-f7fb77413a1c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:10.169030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60766fc-c709-40de-abce-d7c4db84a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:10.169633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60766fc-c709-40de-abce-d7c4db84a3ba None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:10.169906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60766fc-c709-40de-abce-d7c4db84a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:10.170173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60766fc-c709-40de-abce-d7c4db84a3ba None admin] PATH_INFO: `/v3/projects/d678abd51f46479981b5d8e4d153cfa7` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:10.171256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60766fc-c709-40de-abce-d7c4db84a3ba None admin] RBAC: Authorizing `identity:get_project(project_id=d678abd51f46479981b5d8e4d153cfa7)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:10.172699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60766fc-c709-40de-abce-d7c4db84a3ba None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:10.174274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 604/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:10 2022] GET /identity/v3/projects/d678abd51f46479981b5d8e4d153cfa7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:10.180700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:10.255565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:10.276508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2ae70-7cfd-4708-b2c8-49b7a09409f8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:10.310136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:10.310673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:10.310953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:10.311223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:10.311936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=d678abd51f46479981b5d8e4d153cfa7, user.id=466cd2dddc7f4b4ca2af4d0a33bfd0a9) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:10.312243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:10.313707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a0d21-c4ca-4185-b252-6aba9cf3a737 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:10.319251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 557/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:10 2022] GET /identity/v3/role_assignments?user.id=466cd2dddc7f4b4ca2af4d0a33bfd0a9&scope.project.id=d678abd51f46479981b5d8e4d153cfa7&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:12.306857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd232ad-97ce-44fe-811f-442cff59e2a3 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:12.307386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd232ad-97ce-44fe-811f-442cff59e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:12.307386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd232ad-97ce-44fe-811f-442cff59e2a3 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:12.308751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 605/1162] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:12.313856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:12.314272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:12.314406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:12.332171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:12.333389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:12.397783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 558/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:12.420785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd232ad-97ce-44fe-811f-442cff59e2a3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:12.469513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:12.519115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd232ad-97ce-44fe-811f-442cff59e2a3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:12.552112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:12.552796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:12.553074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:12.553344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:12.618098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:12.619470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:12.665051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:12.714741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 606/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:12.720729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:12.788328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:12.818229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4b33-b34f-4b7d-90bd-8edfd8767521 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:12.850152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:12.850794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:12.851071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:12.851340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:12.858306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:12.859736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-855cdb4c-b0c7-46c9-892b-cbdc0dbfc278 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:12.870712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:12.871932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:09:12.872819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 559/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:09:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:12.877819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:12.974749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a8f31-6f1b-4d50-a7c3-df8121f85a02 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:13.007745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:13.008924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:13.009198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:13.009464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:13.010091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:13.010390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:13.011738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0f92-b330-48d2-8916-2d82487af627 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:13.018613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 607/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Aug 7 18:09:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:14.992670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bca14f-0bf0-40a1-9382-ab819bf4a9b0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:14.993205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bca14f-0bf0-40a1-9382-ab819bf4a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:14.993798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bca14f-0bf0-40a1-9382-ab819bf4a9b0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:14.995114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 560/1167] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:15.000207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e2f8-e5d6-49d5-b637-5a64a1177597 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:15.000662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e2f8-e5d6-49d5-b637-5a64a1177597 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:15.000758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e2f8-e5d6-49d5-b637-5a64a1177597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:15.018768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b817e2f8-e5d6-49d5-b637-5a64a1177597 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:15.019934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b817e2f8-e5d6-49d5-b637-5a64a1177597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:15.027833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:15.087345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 608/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:09:15.109437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bca14f-0bf0-40a1-9382-ab819bf4a9b0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:15.208569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bca14f-0bf0-40a1-9382-ab819bf4a9b0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:15.236180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:15.241222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f8511-36d1-4a54-b935-d364d8e2a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:15.241810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f8511-36d1-4a54-b935-d364d8e2a961 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:15.242083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f8511-36d1-4a54-b935-d364d8e2a961 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:15.242862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f8511-36d1-4a54-b935-d364d8e2a961 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:15.243518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f8511-36d1-4a54-b935-d364d8e2a961 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:15.244904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f8511-36d1-4a54-b935-d364d8e2a961 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:15.260650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 561/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Sun Aug 7 18:09:15 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:17.281785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f9d2-ce78-47a3-a9cf-b74d2f88b2c2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:17.282303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f9d2-ce78-47a3-a9cf-b74d2f88b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:17.282303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f9d2-ce78-47a3-a9cf-b74d2f88b2c2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:17.283641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 609/1170] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:17.288878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:17.289274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:17.289933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:17.307885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:17.309103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:17.374583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 562/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:17.397676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f9d2-ce78-47a3-a9cf-b74d2f88b2c2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:17.496344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f9d2-ce78-47a3-a9cf-b74d2f88b2c2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:17.529368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3947b-3ca1-427e-b9b8-a675524a36e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:17.529975 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3947b-3ca1-427e-b9b8-a675524a36e3 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:17.530247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3947b-3ca1-427e-b9b8-a675524a36e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:17.530516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3947b-3ca1-427e-b9b8-a675524a36e3 None admin] PATH_INFO: `/v3/domains/b4ba3cf72f6a4416b6705a6eebfec56a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:17.540673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3947b-3ca1-427e-b9b8-a675524a36e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b4ba3cf72f6a4416b6705a6eebfec56a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:17.542049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3947b-3ca1-427e-b9b8-a675524a36e3 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:17.543579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 610/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Sun Aug 7 18:09:17 2022] GET /identity/v3/domains/b4ba3cf72f6a4416b6705a6eebfec56a => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:17.549490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:17.644230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f614-3c77-476a-8d52-f2e81c4e2a4c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:17.665770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:17.677643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b96ace-1177-4bb9-aa6f-ff3f0ffdeab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:17.678241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96ace-1177-4bb9-aa6f-ff3f0ffdeab8 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:17.678516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96ace-1177-4bb9-aa6f-ff3f0ffdeab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:17.678779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96ace-1177-4bb9-aa6f-ff3f0ffdeab8 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:17.679413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b96ace-1177-4bb9-aa6f-ff3f0ffdeab8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:17.681489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b96ace-1177-4bb9-aa6f-ff3f0ffdeab8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:17.706526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 563/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:09:17 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:09:19.712966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92abb9-9707-4c7b-b70f-df8bd3aa3ee9 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.713500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92abb9-9707-4c7b-b70f-df8bd3aa3ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.713500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92abb9-9707-4c7b-b70f-df8bd3aa3ee9 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.714829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 611/1174] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:19.720114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.720526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.720703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.738855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:19.740039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:19.805442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 564/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:19.829507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92abb9-9707-4c7b-b70f-df8bd3aa3ee9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:19.832336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:19.928712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92abb9-9707-4c7b-b70f-df8bd3aa3ee9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:19.960364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4a0b-e7d7-4f4b-83fa-d207433348dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:19.961514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4a0b-e7d7-4f4b-83fa-d207433348dd None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.961780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4a0b-e7d7-4f4b-83fa-d207433348dd None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.962044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4a0b-e7d7-4f4b-83fa-d207433348dd None admin] PATH_INFO: `/v3/domains/b4ba3cf72f6a4416b6705a6eebfec56a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.963178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a4a0b-e7d7-4f4b-83fa-d207433348dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=b4ba3cf72f6a4416b6705a6eebfec56a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:19.964536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a4a0b-e7d7-4f4b-83fa-d207433348dd None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:19.966138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 612/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Sun Aug 7 18:09:19 2022] GET /identity/v3/domains/b4ba3cf72f6a4416b6705a6eebfec56a => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:19.971736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:20.066656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477d7e-1bdf-44e4-aebe-94c2456c9b01 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:20.068877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:20.099673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5be6-5dfe-4b29-ade9-d1d780028b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:20.100257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5be6-5dfe-4b29-ade9-d1d780028b17 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:20.100527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5be6-5dfe-4b29-ade9-d1d780028b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:20.100828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5be6-5dfe-4b29-ade9-d1d780028b17 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:20.101447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5be6-5dfe-4b29-ade9-d1d780028b17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:20.103515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5be6-5dfe-4b29-ade9-d1d780028b17 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:20.123327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 565/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:09:19 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:22.122286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1f2f-3491-49a2-8eb9-88a23bf3608d None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.122782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1f2f-3491-49a2-8eb9-88a23bf3608d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.122782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1f2f-3491-49a2-8eb9-88a23bf3608d None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.124072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 613/1178] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:22.129280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.129695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.129823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.147792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:22.149091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:22.213805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 566/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:22.237625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1f2f-3491-49a2-8eb9-88a23bf3608d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.307678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:22.339344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1f2f-3491-49a2-8eb9-88a23bf3608d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.372987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.373536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.373810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.374077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.385262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:22.389875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:22.390944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:09:22.392115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 614/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:09:22.396969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.482478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:22.492088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ffc51-0010-492b-8fe1-936aeb0c2f6f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.525043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.525634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.525910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.526177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.526817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:22.527369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:22.528740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:22.536365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 567/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:22.542081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.637480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252c195-390d-43f2-ac1f-bc168682f6ab None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.664879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:22.670459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.671064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.671336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.671604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] PATH_INFO: `/v3/users/fac9cebc10a64c01a7dc6116bc512b05` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.684343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] RBAC: Authorizing `identity:get_user(user_id=fac9cebc10a64c01a7dc6116bc512b05)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:22.685796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:22.687333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 615/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/users/fac9cebc10a64c01a7dc6116bc512b05 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:22.693031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.789524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878949-f8f9-404f-b325-6c701b4a165f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.822056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.822651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.822924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.823192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.843262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:22.888099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:22.889487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:22.982476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 568/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:09:22.988384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:23.086062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1f7a-f416-4292-93db-af68416be46d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:23.120426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd0a4-e06a-4ceb-abba-0cc3fa7f3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:23.121058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd0a4-e06a-4ceb-abba-0cc3fa7f3425 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:23.121334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd0a4-e06a-4ceb-abba-0cc3fa7f3425 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:23.121601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd0a4-e06a-4ceb-abba-0cc3fa7f3425 None admin] PATH_INFO: `/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:23.122693 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd0a4-e06a-4ceb-abba-0cc3fa7f3425 None admin] RBAC: Authorizing `identity:get_project(project_id=683fd5870c364c6d9fcc3d8c0d059aa9)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:23.124119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd0a4-e06a-4ceb-abba-0cc3fa7f3425 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:23.125731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 616/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:23.131743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:23.182731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:23.229025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9027bd-6b91-42be-a9dc-6fdcd792e164 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:23.262912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:23.263499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:23.263771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:23.264037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:23.264762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=683fd5870c364c6d9fcc3d8c0d059aa9, user.id=fac9cebc10a64c01a7dc6116bc512b05) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:23.265062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:23.266464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf271e-61af-4fd3-87b5-f04a6ee8c402 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:23.271528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 569/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:23 2022] GET /identity/v3/role_assignments?user.id=fac9cebc10a64c01a7dc6116bc512b05&scope.project.id=683fd5870c364c6d9fcc3d8c0d059aa9&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:25.214007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241c97d-e16c-4ab4-bc1d-e86ee1455b85 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.214576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241c97d-e16c-4ab4-bc1d-e86ee1455b85 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.214576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241c97d-e16c-4ab4-bc1d-e86ee1455b85 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.215836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 617/1186] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:25.222591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.223044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.223434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.241371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:25.243098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:25.306811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 570/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:25.329442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241c97d-e16c-4ab4-bc1d-e86ee1455b85 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.385617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.429373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241c97d-e16c-4ab4-bc1d-e86ee1455b85 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.462163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.462766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.463036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.463302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.472908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:25.478335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:25.479519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:09:25.480752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 618/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:25.485330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.530269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.581446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e41a1-b052-40d6-b82e-34dab6e73316 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.613959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.614551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.614824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.615089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.615734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:25.616031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:25.618000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:25.625722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 571/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:25.631479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.729182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919658-7cdc-414f-a9f2-f491b41810e9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.745260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.762373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.762979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.763252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.763519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] PATH_INFO: `/v3/users/fac9cebc10a64c01a7dc6116bc512b05` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.764624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] RBAC: Authorizing `identity:get_user(user_id=fac9cebc10a64c01a7dc6116bc512b05)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:25.766025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:25.767560 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 619/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/users/fac9cebc10a64c01a7dc6116bc512b05 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:25.773181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.868745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1914-fdc2-48ab-b901-28463ad2c63a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.877032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.901352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe0829-df4f-4b45-9c52-cec07c5747d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.902211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe0829-df4f-4b45-9c52-cec07c5747d0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.902488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe0829-df4f-4b45-9c52-cec07c5747d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.902753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe0829-df4f-4b45-9c52-cec07c5747d0 None admin] PATH_INFO: `/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.903829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe0829-df4f-4b45-9c52-cec07c5747d0 None admin] RBAC: Authorizing `identity:get_project(project_id=683fd5870c364c6d9fcc3d8c0d059aa9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:25.905267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe0829-df4f-4b45-9c52-cec07c5747d0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:25.906871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 572/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:25.912809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:26.011944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb292-7ed4-4935-8684-adc7ab1fdadb None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:26.046379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc3f68-37cd-4a38-b50b-3b46d250003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:26.047012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc3f68-37cd-4a38-b50b-3b46d250003d None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:26.047286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc3f68-37cd-4a38-b50b-3b46d250003d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:26.047555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc3f68-37cd-4a38-b50b-3b46d250003d None admin] PATH_INFO: `/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9/users/fac9cebc10a64c01a7dc6116bc512b05/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:26.049446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc3f68-37cd-4a38-b50b-3b46d250003d None admin] RBAC: Authorizing `identity:create_grant(project_id=683fd5870c364c6d9fcc3d8c0d059aa9, user_id=fac9cebc10a64c01a7dc6116bc512b05, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:26.050861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc3f68-37cd-4a38-b50b-3b46d250003d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:26.062952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 620/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:09:25 2022] PUT /identity/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9/users/fac9cebc10a64c01a7dc6116bc512b05/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:09:28.026075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef86c-728e-4048-b559-25cd5463f866 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.026592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef86c-728e-4048-b559-25cd5463f866 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.026702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ef86c-728e-4048-b559-25cd5463f866 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.028236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 573/1193] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:28.033220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171842d-a666-4085-b323-2742efd27003 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.033654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171842d-a666-4085-b323-2742efd27003 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.033755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171842d-a666-4085-b323-2742efd27003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.052015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c171842d-a666-4085-b323-2742efd27003 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:28.053180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c171842d-a666-4085-b323-2742efd27003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:28.091669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.118775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 621/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:28.142082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ef86c-728e-4048-b559-25cd5463f866 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.243424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ef86c-728e-4048-b559-25cd5463f866 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.276525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:28.277411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.277687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.277953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.288185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:28.293250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:28.294370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:09:28.295245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 574/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:28.300222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171842d-a666-4085-b323-2742efd27003 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.395655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171842d-a666-4085-b323-2742efd27003 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.428690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:28.429276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.430160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.430622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.431293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:28.431590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:28.432960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:28.440637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 622/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:28.446495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.480318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.541870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc15be-4265-491c-8740-25556c0836e3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.575819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:28.576432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.576735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.577260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] PATH_INFO: `/v3/users/fac9cebc10a64c01a7dc6116bc512b05` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.578374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] RBAC: Authorizing `identity:get_user(user_id=fac9cebc10a64c01a7dc6116bc512b05)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:28.579788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:28.581376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 575/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/users/fac9cebc10a64c01a7dc6116bc512b05 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:28.587434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.623338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.686328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293bd52-5a2c-4ade-a0e8-1c594247fa7c None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.718453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:28.719042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.719320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.719598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.785502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:28.786939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:28.819674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.883109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 623/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:28.889252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.987638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a387-d579-4c2a-84a6-29697d243879 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.989927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:29.020295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b45e68-4928-476b-895b-cd7183ea7507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:29.020939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b45e68-4928-476b-895b-cd7183ea7507 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:29.021224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b45e68-4928-476b-895b-cd7183ea7507 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:29.021497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b45e68-4928-476b-895b-cd7183ea7507 None admin] PATH_INFO: `/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:29.022599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b45e68-4928-476b-895b-cd7183ea7507 None admin] RBAC: Authorizing `identity:get_project(project_id=683fd5870c364c6d9fcc3d8c0d059aa9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:29.024861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b45e68-4928-476b-895b-cd7183ea7507 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:29.026479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 576/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/projects/683fd5870c364c6d9fcc3d8c0d059aa9 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:29.032849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:29.128111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0218f3-bf58-4345-aba7-fb476a4e727b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:29.161998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:29.162580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:29.162852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:29.163118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:29.163822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=683fd5870c364c6d9fcc3d8c0d059aa9, user.id=fac9cebc10a64c01a7dc6116bc512b05) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:29.164158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:29.165763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee313a-7c2f-4f11-b94c-bcb0f324c4cf None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:29.168503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:29.172021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 624/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:29 2022] GET /identity/v3/role_assignments?user.id=fac9cebc10a64c01a7dc6116bc512b05&scope.project.id=683fd5870c364c6d9fcc3d8c0d059aa9&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:39.016215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=14 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:24.176762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817394-6f7e-40c9-88d8-ada49f56c846 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:24.177436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817394-6f7e-40c9-88d8-ada49f56c846 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:24.177436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817394-6f7e-40c9-88d8-ada49f56c846 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:24.178886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 577/1201] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:24.185263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:24.185783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:24.185882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:24.214765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:24.214765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:24.306145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 625/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:24.332654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51817394-6f7e-40c9-88d8-ada49f56c846 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:24.480356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51817394-6f7e-40c9-88d8-ada49f56c846 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:24.528527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:24.529658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:24.529903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:24.530176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:24.543897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:24.545578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:24.569610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:24.571022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:24.572004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:24.572004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:24.572004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:24.572004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 578/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:24.578801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:24.723670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec519bb8-c7e0-4531-826a-916c317df0cc None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:24.767830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:24.776348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:24.777054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:24.777345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:24.777676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:24.778703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:24.779038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:24.780501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2d894-401b-4ef2-8dad-e55bd0ffe7f0 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:24.803502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 626/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:24.810198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:24.880450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:24.946024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5199-6183-44ef-a1f5-c7ca039cdf54 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:24.986836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92c465-a361-4713-9ca0-676f4766fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:24.987727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92c465-a361-4713-9ca0-676f4766fbdd None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:24.988196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92c465-a361-4713-9ca0-676f4766fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:24.988645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92c465-a361-4713-9ca0-676f4766fbdd None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:24.989496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92c465-a361-4713-9ca0-676f4766fbdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:24.991778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92c465-a361-4713-9ca0-676f4766fbdd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:25.018552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 579/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Aug 7 18:10:24 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:10:27.261766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55212f9-71fd-4818-89d1-c028d94f4065 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:27.262370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55212f9-71fd-4818-89d1-c028d94f4065 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:27.262370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55212f9-71fd-4818-89d1-c028d94f4065 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:27.263756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 627/1206] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:27.269626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:27.270057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:27.270171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:27.290289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:27.291427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:27.364681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 580/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:27.390692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55212f9-71fd-4818-89d1-c028d94f4065 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:27.511409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55212f9-71fd-4818-89d1-c028d94f4065 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:27.560416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:27.561047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:27.561434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:27.561704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:27.573992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:27.578696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:27.579907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:27.581282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 628/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:10:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:27.586060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:27.639862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:27.714223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1002c-d41b-4045-bb4c-697e8066aef4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:27.752791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:27.754000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:27.754250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:27.754522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:27.755319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:27.755623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:27.757996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:27.770416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 581/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:10:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:27.776928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:27.841092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:27.896946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa287a-6dc5-4d4a-96e1-06959b8edbf9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:27.942316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:27.943305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:27.943699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:27.944448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:27.957685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:27.959151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:27.975183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:27.977222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:27.978489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:27.978489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:27.978489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:27.980797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 629/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:27.983074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:28.101097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:28.109308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566abba5-b345-42e0-a162-db86dec70fac None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:28.152547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:28.153596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:28.153974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:28.154304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:28.155024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:28.155336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:28.156770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:28.171811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 582/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:28.177806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:28.296844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d714145-3c2b-4079-8ea2-cec885821bd0 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:28.298423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:28.336475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:28.337163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:28.337483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:28.337784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:28.346303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:28.347925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:28.360493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:28.361849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:28.363138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:28.364973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 630/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:28.367377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:28.486664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f59d7-9314-44e4-99ef-d12c0b0ba4c1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:28.524094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:28.524814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:28.525271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:28.525569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:28.526429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:28.526843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:28.528808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:28.549949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 583/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:28.556553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:28.687791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdbdea-3938-4db8-820f-3a7aec00f0c9 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:28.727035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:28.727641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:28.727918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:28.728191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:28.767579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:28.820471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:28.822131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:28.942756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 631/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:28.944220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:28.969088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:29.068666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0073-6b10-465d-94d7-de356f54ea10 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:29.111300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:29.112050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:29.112449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:29.112800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:29.124534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:29.126388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:29.144924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:29.146189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:29.152056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:29.152056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:29.152056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:29.152056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 584/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:29.152437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:29.227017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:29.275064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7500a-cf7f-4302-9b79-46342cbeb6df None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:29.323280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:29.323977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:29.324272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:29.324502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:29.325270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:29.325536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:29.326936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:29.339730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 632/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:29.345411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:29.428638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:29.464898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885cf1a-f33e-4971-a6d2-1da955b41abb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:29.510011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:29.510617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:29.510893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:29.511161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:29.518785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:29.520472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:29.532674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:29.533782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:29.534846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:29.538823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 585/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:29.539778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:29.644666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1715-97f1-4c33-8034-097f8641c65f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:29.671652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:29.691009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:29.691606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:29.691884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:29.692169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:29.692883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:29.693184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:29.694623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c6c71-e56a-4795-8463-78046baba3ee None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:29.713703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 633/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:29.715058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:29.829543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367036e-d5a8-4a4a-bcf9-c281744800ab None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:29.862862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:29.869859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:29.870430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:29.870708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:29.870979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:29.871690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=3a8c8efd39f14b65984c0d2a8782e48e) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:29.871999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:29.873458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c40c-a0f9-40bf-a582-f610eda2ce54 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:29.887185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 586/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:29 2022] GET /identity/v3/role_assignments?user.id=3a8c8efd39f14b65984c0d2a8782e48e&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:31.935636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7175d-a875-4043-b00f-f6d89cc37169 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:31.936255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7175d-a875-4043-b00f-f6d89cc37169 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:31.936255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7175d-a875-4043-b00f-f6d89cc37169 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:31.937542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 634/1220] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:10:31.942969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:31.943395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:31.943585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:31.963452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:31.964740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:32.049042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 587/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:32.066644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7175d-a875-4043-b00f-f6d89cc37169 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:32.193064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7175d-a875-4043-b00f-f6d89cc37169 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:32.231091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:32.231730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:32.232004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:32.232274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:32.246780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:32.251471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:32.252969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:32.253953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 635/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:10:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:32.258869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:32.365359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a09e1c-3a96-4ef8-8499-86f9d7d5e61d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:32.393573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:32.406286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:32.406912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:32.407197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:32.407450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:32.408121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:32.408400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:32.409820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:32.420111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 588/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:10:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:32.426554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:32.474247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:32.537335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a16e5-3275-4372-a0ab-3ed041cc0bf2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:32.571263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:32.571875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:32.572147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:32.572412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:32.582216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:32.583781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:32.600152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:32.601868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:32.602743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:32.602743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:32.602743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:32.602743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 636/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:32.607924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:32.719799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a9b34-c053-4117-98a5-5f39dc869e3c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:32.755931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:32.756614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:32.756904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:32.757175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:32.757811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:32.758113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:32.759474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:32.771252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 589/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:32.779033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:32.879713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:32.887588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e449cc-a9cc-43f9-b41e-fa03a7bbbe17 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:32.921860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:32.922477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:32.922753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:32.923025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:32.931393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:32.933251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:32.946702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:32.948215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:32.949184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 637/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:32.953866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:33.002096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:33.064996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6496ff4-f57e-4b3e-86c4-f3d353e33854 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:33.104213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:33.104852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:33.105134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:33.105406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:33.106129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:33.106439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:33.107855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:33.126358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 590/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:33.132883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:33.255290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c12d-f501-415e-9eb0-fb5e23ef128f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:33.294611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:33.295260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:33.295539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:33.295803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:33.307772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:33.309353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:33.324365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:33.325612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:33.326800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:33.326800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:33.326800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:33.331384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:33.331827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 638/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:33.460666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038a2d3-2d82-4347-b2d7-1a019ef2d765 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:33.462978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:33.497961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:33.498671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:33.498853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:33.500095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:33.500095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:33.500095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:33.501461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:33.516965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 591/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:33.523205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:33.533388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:33.644235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0516-b6c7-4a0f-ae42-aac3ccda7f59 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:33.682546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:33.683175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:33.683449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:33.683718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:33.691588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:33.693912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:33.710758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:33.711903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:33.713028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 639/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:33.718493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:33.832687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2bed-f464-45e7-81d5-2ff7dd5e9d60 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:33.873230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:33.874397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:33.874848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:33.875292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:33.876285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:33.876643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:33.878752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2db9d-cbaa-4d7e-86f2-2a5074d9a64c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:33.894613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 592/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:33.902726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:33.975203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:34.014389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013054b-5013-461f-85eb-7007c6ee5524 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:34.050229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27f09-f1ed-4648-8e88-9b3e0f612a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:34.050813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27f09-f1ed-4648-8e88-9b3e0f612a18 None admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:34.051092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27f09-f1ed-4648-8e88-9b3e0f612a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:34.051362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27f09-f1ed-4648-8e88-9b3e0f612a18 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/3a8c8efd39f14b65984c0d2a8782e48e/roles/e3ad81e678c243b8a63503d7047271f6` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:34.067048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27f09-f1ed-4648-8e88-9b3e0f612a18 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=3a8c8efd39f14b65984c0d2a8782e48e, role_id=e3ad81e678c243b8a63503d7047271f6)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:34.068490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27f09-f1ed-4648-8e88-9b3e0f612a18 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:34.082830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 640/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:10:33 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/3a8c8efd39f14b65984c0d2a8782e48e/roles/e3ad81e678c243b8a63503d7047271f6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:10:36.133325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde87b3-d215-44a6-9db9-5f174966abd3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:36.133850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde87b3-d215-44a6-9db9-5f174966abd3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:36.133850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde87b3-d215-44a6-9db9-5f174966abd3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:36.135129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 593/1233] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:10:36.140267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:36.140664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:36.140835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:36.161569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:36.162788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:36.237978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 641/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:36.261990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde87b3-d215-44a6-9db9-5f174966abd3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:36.287688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:36.367269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde87b3-d215-44a6-9db9-5f174966abd3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:36.406814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:36.407536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:36.407843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:36.408102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:36.420907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:36.426417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:36.433142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:36.434134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 594/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Aug 7 18:10:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:36.434833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:36.481721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:36.543689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed03710-c277-42ef-b945-f5bd1854a0ee None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:36.580416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:36.581047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:36.581483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:36.581793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:36.582454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:36.582851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:36.584767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:36.593941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 642/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Aug 7 18:10:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:36.600690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:36.699699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:36.719969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b266-f2b6-4c4b-a95c-cadab9983bbc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:36.758223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:36.759103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:36.759521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:36.759962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:36.773985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:36.775629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:36.791584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:36.792541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:36.793764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:36.793764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:36.793764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:36.795667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 595/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:36.801770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:36.924902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c3df-46db-4155-a8bd-34165ee919b8 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:36.934484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:36.962325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:36.962928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:36.963204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:36.963474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:36.964104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:36.964406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:36.965820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:36.978081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 643/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:36.984232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:37.093428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205da9-4919-4a79-834e-1fd231e8d0f9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:37.133077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:37.133699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:37.134295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:37.134403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:37.137122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:37.144358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:37.146029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:37.158190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:37.159226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:37.161009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 596/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:37.165627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:37.275158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131da6de-d044-4881-b555-3d15e6fd77aa None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:37.311959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:37.312593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:37.312874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:37.313163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:37.313854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:37.314151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:37.315555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:37.334538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 644/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:37.341029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:37.461901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e1fe6-7b11-4769-9efc-def1e00edaa4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:37.498889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:37.499523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:37.499822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:37.500120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:37.568155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:37.576518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:37.578042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:37.687505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 597/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:37.694876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:37.725034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:37.808647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fe2e9-977f-4b0c-9f84-3ebec4dd4000 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:37.848728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:37.849323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:37.849602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:37.849871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:37.865114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:37.867835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:37.884340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:37.885957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:37.886884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:37.886884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:37.886884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:37.886884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 645/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:37.891450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:37.992254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:37.998610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f267-0096-47a8-aecf-048da69a746f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:38.039835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:38.040485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:38.040800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:38.041121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:38.041764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:38.042082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:38.043609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:38.058867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 598/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:38.065129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:38.158433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:38.183904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b3444-6106-41cb-b00b-95b99f4136fa None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:38.220881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:38.221647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:38.221969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:38.222276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:38.230951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:38.232658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:38.246027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:38.247000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:38.247888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 646/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:38.253550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:38.372360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0de6e2-74b7-4d26-84b7-753f81d7956e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:38.418391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:38.419243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:38.419631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:38.419907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:38.420725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:38.421100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:38.422923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ded2e-053a-4145-afe9-4176fd679063 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:38.439112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 599/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:38.445978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:38.557051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830928a0-14e2-443e-8e4f-e721e8e3fae2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:38.594119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:38.594759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:38.594999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:38.595304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:38.596228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] RBAC: Adding query filter params (role.id=e3ad81e678c243b8a63503d7047271f6, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=3a8c8efd39f14b65984c0d2a8782e48e) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:38.596528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:38.597979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a032-ed3e-4ba1-a00c-08ee73c67d3c None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:38.604754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 647/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:38 2022] GET /identity/v3/role_assignments?user.id=3a8c8efd39f14b65984c0d2a8782e48e&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=e3ad81e678c243b8a63503d7047271f6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:40.710973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf62f-37fd-474d-8a21-dafe7209b734 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:40.711518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf62f-37fd-474d-8a21-dafe7209b734 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:40.711640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf62f-37fd-474d-8a21-dafe7209b734 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:40.713119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 600/1247] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:10:40.718183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:40.718737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:40.718882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:40.725832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:40.738410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:40.739586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:40.814012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 648/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:40.842364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf62f-37fd-474d-8a21-dafe7209b734 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:40.864060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:40.965010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf62f-37fd-474d-8a21-dafe7209b734 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:41.004206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:41.004862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:41.006214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:41.006214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:41.018595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:41.023292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:41.024259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:41.025228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 601/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:41.030870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:41.143775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86871b95-d572-43ae-8edf-fb84663396f0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:41.180449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:41.188020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e554cb-0412-4061-991c-b975d617869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:41.188927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e554cb-0412-4061-991c-b975d617869a None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:41.189214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e554cb-0412-4061-991c-b975d617869a None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:41.189554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e554cb-0412-4061-991c-b975d617869a None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:41.190494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e554cb-0412-4061-991c-b975d617869a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:41.190825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e554cb-0412-4061-991c-b975d617869a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:41.192768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e554cb-0412-4061-991c-b975d617869a None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:41.205620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 649/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:41.212266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:41.312999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:41.341659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525febd-f91b-49cc-945d-5a3fb7ebf39d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:41.384145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:41.385309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:41.385701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:41.386040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:41.405445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:41.407972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:41.431853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:41.433248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:41.439013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:41.439013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:41.439013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:41.439013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 602/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:41.439547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e554cb-0412-4061-991c-b975d617869a None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:41.548164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e554cb-0412-4061-991c-b975d617869a None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:41.587094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:41.587662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:41.587936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:41.588203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:41.588867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:41.589166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:41.590541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:41.607240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 650/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:41.613557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:41.741092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41640abf-49fb-4267-818e-01570e8bae0b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:41.770875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:41.779909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:41.780620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:41.780916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:41.781168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:41.791721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:41.791721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:41.806127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:41.807180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:41.808122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 603/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:41.813614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:41.882862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:41.934192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eb22e-bfb3-45f7-8f46-b89a1e1e2951 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:41.972856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:41.973458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:41.973736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:41.974002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:41.974835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:41.975668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:41.977301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:41.995309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 651/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:42.001246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:42.116535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba841d-ea47-4de9-9306-d8251b0dd4dd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:42.155944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:42.156522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:42.156834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:42.157109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:42.222278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:42.236889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:42.238451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:42.354180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 604/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:42.360739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:42.495117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805e35-7baa-402a-9216-8630a4d2375d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:42.508434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:42.530454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:42.531067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:42.531342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:42.531611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:42.542125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:42.543548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:42.558227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:42.559271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:42.560171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:42.560171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:42.560171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:42.560171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 652/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:42.565106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:42.664847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:42.681531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d93684-6a32-4ccd-a421-a7775b43e0ca None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:42.724520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:42.725944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:42.726331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:42.726632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:42.727376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:42.727815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:42.729366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:42.743625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 605/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:42.749517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:42.869074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810ab2-ac4b-40b5-b5d3-21b64d961f96 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:42.906949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:42.907640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:42.907986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:42.908260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:42.916261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:42.917985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:42.929866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:42.930861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:42.931752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 653/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:42.937637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:43.045203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c496cc-43b7-48eb-8de2-b3fce3bb2a4b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:43.083586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:43.084867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.085165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.085443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.086202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:43.086497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:43.088203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333e0c-984c-4a04-bfd7-80b1c2d1531a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:43.108436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 606/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:43.109634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:43.139107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:43.228813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85452edf-5e6c-4635-b13b-c80cf48f2fa8 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:43.264172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:43.264797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.265076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.265332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.266050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=3a8c8efd39f14b65984c0d2a8782e48e) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:43.266328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:43.267749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae27c-5990-4dcc-a1ad-71fd1e79f058 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:43.273788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 654/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:43 2022] GET /identity/v3/role_assignments?user.id=3a8c8efd39f14b65984c0d2a8782e48e&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:45.323799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef3419-d017-46f1-9e85-b5c58f3734bd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.324353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef3419-d017-46f1-9e85-b5c58f3734bd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.324353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef3419-d017-46f1-9e85-b5c58f3734bd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.325700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 607/1261] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:45.330885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.331262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.331430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.351002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:45.352185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:45.427636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 655/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:45.449762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef3419-d017-46f1-9e85-b5c58f3734bd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.461060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.551092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef3419-d017-46f1-9e85-b5c58f3734bd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.583597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.584155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.585005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.585333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.594996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:45.599641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:45.600850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:45.601877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 608/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:45.606953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.625110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.704707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625d96-a885-4d66-94fe-9e152d17be49 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.737518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.738111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.738382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.738648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.739295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:45.739589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:45.741120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:45.749194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 656/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:45.755263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.822714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.855160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bf1d5-e2c1-43ad-a920-b97fb2d9a709 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.887653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.888263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.888535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.888831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.899176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:45.900620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:45.914968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:45.916124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:45.917235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:45.917235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:45.917235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:45.917235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 609/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:45.921820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.000216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:46.019189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf6be-1fea-4eac-99c9-4787a73b64e7 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:46.051291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:46.051870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:46.052147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:46.052411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:46.053628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:46.054164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:46.055517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:46.066904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 657/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:46.072792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.169575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bc88-9af0-4452-8f93-5b7d5a4b1385 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:46.188615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:46.203404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:46.204017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:46.204290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:46.204585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:46.211804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:46.213260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:46.223801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:46.224898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:46.226053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 610/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:46.230826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.329568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09010ec7-7ec2-4f54-81ab-7288df7b239d None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:46.362856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:46.363442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:46.363716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:46.363984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:46.364724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:46.365024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:46.367356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:46.375995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:46.386076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 658/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:46.393229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.493508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403deb8-a315-4357-a752-e0162d8870a3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:46.525602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:46.526214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:46.526494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:46.526765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:46.537182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:46.539252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:46.552834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:46.554459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:46.555561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:46.555561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:46.555561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:46.555561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 611/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:46.560226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.657514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6537b-6e38-488f-b5a2-d034ab81f917 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:46.690838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:46.691422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:46.691693 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:46.691957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:46.692596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:46.692896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:46.694703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:46.705446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 659/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:46.711001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.742791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:46.810217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca3d34-fc5c-4788-ac14-a4f807fdeaa8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:46.842729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:46.843335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:46.843607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:46.843868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:46.850850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:46.852256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:46.862947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:46.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:46.864931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 612/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:46.869853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:46.928175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:46.968930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884495-1710-402d-a817-4b7ff0f880f2 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:47.001316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:47.001902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:47.002174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:47.002441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:47.003115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:47.003416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:47.004853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03878-b6b4-4c4c-96ff-0d38edcc4c41 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:47.016378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 660/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:47.022875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:47.111919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:47.120687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e19c8-dc87-4fda-8f37-fcc42a24380f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:47.153326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb970be-46cc-4d11-bf81-d057535f6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:47.154228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb970be-46cc-4d11-bf81-d057535f6035 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:47.154503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb970be-46cc-4d11-bf81-d057535f6035 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:47.154774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb970be-46cc-4d11-bf81-d057535f6035 None admin] PATH_INFO: `/v3/projects/e3cceea278344db49b58367c7f0b8156/users/3a8c8efd39f14b65984c0d2a8782e48e/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:47.156654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb970be-46cc-4d11-bf81-d057535f6035 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cceea278344db49b58367c7f0b8156, user_id=3a8c8efd39f14b65984c0d2a8782e48e, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:47.158075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb970be-46cc-4d11-bf81-d057535f6035 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:47.170238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 613/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Aug 7 18:10:47 2022] PUT /identity/v3/projects/e3cceea278344db49b58367c7f0b8156/users/3a8c8efd39f14b65984c0d2a8782e48e/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:10:49.144279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64c3c7-e960-442b-acbe-970248e6f8b1 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.144814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64c3c7-e960-442b-acbe-970248e6f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.144814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64c3c7-e960-442b-acbe-970248e6f8b1 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.146108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 661/1274] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:49.151986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.152450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.152544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.171049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:49.172239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:49.236538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 614/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:49.260009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64c3c7-e960-442b-acbe-970248e6f8b1 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.372265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64c3c7-e960-442b-acbe-970248e6f8b1 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.397870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:49.427164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.428186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.428687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.428795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.444063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:49.449240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:49.451539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:49.453643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 662/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:49.456640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.541221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:49.567219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b27fc9-8d25-48b5-aeb3-982f7139a1c9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.614930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.615634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.615916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.616182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.616872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:49.617174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.618863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.631749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 615/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:49.637672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.744353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5d24a-98de-45d5-ad0b-2c12716997b1 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.779335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.779963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.780248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.780522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.791828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.793309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:49.809159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:49.810382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:49.811681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:49.811681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:49.811681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:49.811681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 663/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:49.816055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.916364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a3985-4331-4618-bb47-2774098d5c61 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.950857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.951448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.951726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.951993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.952644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:49.952944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.954307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.966450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 616/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:49.972191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:50.004298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:50.079789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aae64f-5708-46fa-b85a-703ccd830f71 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:50.112973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:50.113580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:50.113851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:50.114118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:50.121883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:50.123310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:50.134347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:50.135440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:50.136402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 664/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:50.141388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:50.145148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:50.238828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40f68-7133-485a-afe4-dca51c60d763 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:50.271980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:50.272435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:50.272739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:50.273008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:50.273712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:50.274012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:50.275413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:50.292421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 617/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:50.298471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:50.394275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:50.405993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c25d4-f7e2-4df1-8583-93894489b97f None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:50.439424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:50.440016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:50.440294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:50.440596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:50.505243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:50.506733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:50.592241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:50.602831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 665/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:50.608829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:50.668580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:50.706848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ca2f-ba7a-4929-9890-2b411b4bd334 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:50.739210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:50.739823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:50.740100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:50.740913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:50.750611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:50.752042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:50.766660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:50.767748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:50.769021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:50.769021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:50.769021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:50.769021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 618/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:50.773637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:50.870530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e5a5b-1a0b-48e7-a5ee-118fe2e7c859 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:50.903115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:50.903949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:50.904221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:50.904486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:50.905161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:50.905457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:50.906800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:50.918249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 666/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:50.923963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:51.021645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77175-5eee-4978-850c-1295f0045bc9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:51.034719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:51.055481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:51.056090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:51.056367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:51.056664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:51.062994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:51.064415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:51.075370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:51.076439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Aug 07 18:10:51.077625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 619/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:51.082220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:51.132016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:51.182031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec768a-90f5-47ab-abb0-57ce3489fb35 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:51.214158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:51.214747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:51.215025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:51.215300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:51.215979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:51.216282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:51.217746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb31ae6-63aa-44ec-986f-326b6fd9d759 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:51.229903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 667/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:51.235925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:51.333716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136623a-42b3-45f8-98f7-97bbc43c90dd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:51.366495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:51.367079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:51.367357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:51.367624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:51.368321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] RBAC: Adding query filter params (role.id=866f8af7cc5d4f7e994315a5051b1c0c, scope.project.id=e3cceea278344db49b58367c7f0b8156, user.id=3a8c8efd39f14b65984c0d2a8782e48e) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:51.368656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:51.370068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa216e57-cb50-4f6b-90bf-710b1e9629c0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:51.376984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 620/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:51 2022] GET /identity/v3/role_assignments?user.id=3a8c8efd39f14b65984c0d2a8782e48e&scope.project.id=e3cceea278344db49b58367c7f0b8156&role.id=866f8af7cc5d4f7e994315a5051b1c0c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:53.413161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75054-89e4-48f2-80ff-8f83e89e2ca4 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.413692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75054-89e4-48f2-80ff-8f83e89e2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.413692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75054-89e4-48f2-80ff-8f83e89e2ca4 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.415064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 668/1288] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:53.420242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.420648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.420809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.438483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:53.439655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:53.469071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:53.505370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 621/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:53.527467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75054-89e4-48f2-80ff-8f83e89e2ca4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.625840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75054-89e4-48f2-80ff-8f83e89e2ca4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.636748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:53.659949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.660579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.660855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.661122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.661690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.663267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:53.671577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:53.672767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:10:53.673807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:53.676705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 669/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:53.679249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.773591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05837b03-dc99-4b07-9434-b6e1917bebf5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.808636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.809237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.809509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.809780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.810393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:53.810688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.812034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437e978-96a2-46a4-85e9-94f61039da74 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.816667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 622/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:53.823032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.922051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d7144-5ce6-4d5b-9608-f61124611a42 None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.954262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.954838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.955108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.955370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] PATH_INFO: `/v3/services` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.955974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:53.956266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.957648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380dca7-7c23-40ad-9f3e-22d259a7d083 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.962486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 670/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:55.943673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e0a91-361b-4daa-8cd9-debaa212f24b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:55.944192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e0a91-361b-4daa-8cd9-debaa212f24b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:55.944192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e0a91-361b-4daa-8cd9-debaa212f24b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:55.945577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 623/1293] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:55.950621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fe1e-e06d-4801-be9e-044e7b10dc48 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:55.950989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fe1e-e06d-4801-be9e-044e7b10dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:55.951160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47fe1e-e06d-4801-be9e-044e7b10dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:55.969188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fc47fe1e-e06d-4801-be9e-044e7b10dc48 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:55.970357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fc47fe1e-e06d-4801-be9e-044e7b10dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:55.998993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:56.035717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 671/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:56.057847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e0a91-361b-4daa-8cd9-debaa212f24b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:56.088246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:56.156816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e0a91-361b-4daa-8cd9-debaa212f24b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:56.188991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb0a24-6cd5-49e1-84bc-0d397b15f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:56.189581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb0a24-6cd5-49e1-84bc-0d397b15f5b4 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:56.189856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb0a24-6cd5-49e1-84bc-0d397b15f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:56.190128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb0a24-6cd5-49e1-84bc-0d397b15f5b4 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:56.190768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb0a24-6cd5-49e1-84bc-0d397b15f5b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:56.192113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb0a24-6cd5-49e1-84bc-0d397b15f5b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:56.206454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 624/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Aug 7 18:10:56 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:10:58.215562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ec24d-837a-4741-9273-7656262c27ce None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.216141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ec24d-837a-4741-9273-7656262c27ce None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.216141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ec24d-837a-4741-9273-7656262c27ce None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.217453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 672/1296] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:58.222429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.222870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.222983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.241124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:58.242306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:58.312162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 625/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:58.335191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ec24d-837a-4741-9273-7656262c27ce None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.446407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ec24d-837a-4741-9273-7656262c27ce None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.479228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.479781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.480050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.480317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.480912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.482254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:58.491201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:58.492476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:10:58.493446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 673/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:58.498549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.516259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.595108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f9f4-4a0b-43a8-a9ad-78c9bbf71a0f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.627975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.628593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.628875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.629146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.629760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:58.630058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.631466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.636465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 626/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:58.642307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.673640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.739876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7d0a-3a51-41ee-b987-c8fe03e6a68b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.772497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.773089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.773360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.773627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.774307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] RBAC: Adding query filter params (interface=public, service_id=231e1f41b8f74c09addaa42dbd6ab5ba, region_id=RegionOne) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:58.774607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.775952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1afce-f8f2-47cb-b731-508bd0a0c991 None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.781086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 674/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/endpoints?service_id=231e1f41b8f74c09addaa42dbd6ab5ba&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:58.786623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.866779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.886960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11deb8b-c16e-4470-a711-42c517eef4ce None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.920546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a95a6-04dd-4d63-a1f9-efce7ad25621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.921172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a95a6-04dd-4d63-a1f9-efce7ad25621 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.921610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a95a6-04dd-4d63-a1f9-efce7ad25621 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.921737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a95a6-04dd-4d63-a1f9-efce7ad25621 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.922302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a95a6-04dd-4d63-a1f9-efce7ad25621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.923657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a95a6-04dd-4d63-a1f9-efce7ad25621 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.930273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 627/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:11:00.917114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35db7-cacc-4242-ac93-74923997057a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:00.917657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35db7-cacc-4242-ac93-74923997057a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:00.917657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35db7-cacc-4242-ac93-74923997057a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:00.918977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 675/1302] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:00.924070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:00.924456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:00.924642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:00.942606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:00.943818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:01.007131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 628/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:11:01.029797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a35db7-cacc-4242-ac93-74923997057a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:01.123419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:01.130343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a35db7-cacc-4242-ac93-74923997057a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:01.163394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:01.163992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:01.164264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:01.164537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:01.165135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:01.166479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:01.174967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:01.176121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: ERROR keystone.server.flask.application Aug 07 18:11:01.177007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 676/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Aug 7 18:11:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:01.181939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:01.254871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:01.277596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50af89-e78a-4bfd-9f94-53f42bf3aeff None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:01.310446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:01.311041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:01.311317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:01.311588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:01.312204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:01.312502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:01.313874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268099f-0327-41e5-84bf-cc7d7049645f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:01.318804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 629/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Aug 7 18:11:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:01.324484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:01.440264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b82a-8506-412d-89e9-a4f92318e44b None admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:01.474324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81dfd1-fe1f-4487-95c4-c8b07311853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:01.475476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81dfd1-fe1f-4487-95c4-c8b07311853e None admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:01.475772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81dfd1-fe1f-4487-95c4-c8b07311853e None admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:01.476051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81dfd1-fe1f-4487-95c4-c8b07311853e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:01.476739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81dfd1-fe1f-4487-95c4-c8b07311853e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:01.478103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81dfd1-fe1f-4487-95c4-c8b07311853e None admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:01.497190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 677/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:11:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:11:11.316240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=30 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:11.492980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:04.410097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804b97-1212-4bbd-b69e-a6655cd6555a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:04.410658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804b97-1212-4bbd-b69e-a6655cd6555a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:04.410658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804b97-1212-4bbd-b69e-a6655cd6555a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:04.416836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 630/1307] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:04.418237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daa138-0e16-428e-908e-689c0f6a1115 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:04.418715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daa138-0e16-428e-908e-689c0f6a1115 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:04.418715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daa138-0e16-428e-908e-689c0f6a1115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:04.512665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d4daa138-0e16-428e-908e-689c0f6a1115 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:04.513878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d4daa138-0e16-428e-908e-689c0f6a1115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:04.644840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 678/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:04.700045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660df779-76fb-4f5e-9235-3ec9b44c283f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:04.700618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660df779-76fb-4f5e-9235-3ec9b44c283f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:04.701142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660df779-76fb-4f5e-9235-3ec9b44c283f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:04.703021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 631/1309] 10.222.0.25 () {54 vars in 965 bytes} [Sun Aug 7 18:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:04.709701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713d6a-ee83-41bc-9e07-9750ce852809 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:04.710126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713d6a-ee83-41bc-9e07-9750ce852809 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:04.710534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713d6a-ee83-41bc-9e07-9750ce852809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:04.816886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-69713d6a-ee83-41bc-9e07-9750ce852809 None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:04.818497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-69713d6a-ee83-41bc-9e07-9750ce852809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:04.842723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:04.925387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 679/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Sun Aug 7 18:12:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:12:04.926142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660df779-76fb-4f5e-9235-3ec9b44c283f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:04.929237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-660df779-76fb-4f5e-9235-3ec9b44c283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:05.078353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660df779-76fb-4f5e-9235-3ec9b44c283f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:05.158672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:05.159617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:05.160039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:05.160453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:05.162966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:05.221266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:05.280112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:05.281586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f4277-54e4-43dc-97be-feb87f322218 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:05.301308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 632/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:07.638854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ded44-f435-418a-b449-a5a6c74efedd None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:07.639430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ded44-f435-418a-b449-a5a6c74efedd None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:07.639430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ded44-f435-418a-b449-a5a6c74efedd None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:07.640826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 680/1312] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:07.647194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834bf4-8c40-40aa-b792-037a330ae816 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:07.647602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834bf4-8c40-40aa-b792-037a330ae816 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:07.647735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834bf4-8c40-40aa-b792-037a330ae816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:07.728387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3c834bf4-8c40-40aa-b792-037a330ae816 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:07.729642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3c834bf4-8c40-40aa-b792-037a330ae816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:07.841087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 633/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:07.880604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ded44-f435-418a-b449-a5a6c74efedd None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:07.882414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ae9ded44-f435-418a-b449-a5a6c74efedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:08.000205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ded44-f435-418a-b449-a5a6c74efedd None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:08.076920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:08.079681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:08.080392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:08.081088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:08.081839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:08.084087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:08.205580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:08.207235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00af60b-0606-496a-b1c2-d6d22fe0fbcc service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:08.228379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 681/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:10.590939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208920ce-a6c7-42b2-9e44-d2434f0187e5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:10.591469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208920ce-a6c7-42b2-9e44-d2434f0187e5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:10.591469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208920ce-a6c7-42b2-9e44-d2434f0187e5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:10.592765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 634/1315] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:10.597769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eb972-2e30-445d-8d45-ae3b30d86a4f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:10.598190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eb972-2e30-445d-8d45-ae3b30d86a4f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:10.598332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eb972-2e30-445d-8d45-ae3b30d86a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:10.663270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e26eb972-2e30-445d-8d45-ae3b30d86a4f None None] MFA Rules not processed for user `cb7ed9b5bb6b47519b15cad121f36d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:10.664484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e26eb972-2e30-445d-8d45-ae3b30d86a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:10.717187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:10.762138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 682/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:10.802667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208920ce-a6c7-42b2-9e44-d2434f0187e5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:10.804272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-208920ce-a6c7-42b2-9e44-d2434f0187e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:10.814065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:10.908016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208920ce-a6c7-42b2-9e44-d2434f0187e5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:10.979919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:10.980522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:10.980823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:10.981090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:10.982672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:11.044714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:11.091552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:11.093070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21840e-ba1f-4ae0-b9e0-634d40c18ed5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:11.110871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 635/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:13.667971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848ca5-288c-42ce-9d63-8ce7a5a92175 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:13.668536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848ca5-288c-42ce-9d63-8ce7a5a92175 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:13.668536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848ca5-288c-42ce-9d63-8ce7a5a92175 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:13.669919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 683/1318] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:13.674935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad298-5afd-46ba-a5cc-e3da18ae7190 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:13.675351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad298-5afd-46ba-a5cc-e3da18ae7190 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:13.675497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad298-5afd-46ba-a5cc-e3da18ae7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:13.741188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f48ad298-5afd-46ba-a5cc-e3da18ae7190 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:13.742407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f48ad298-5afd-46ba-a5cc-e3da18ae7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:13.838531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 636/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:13.890010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c851b-5abb-4f44-a7c9-9fb31a385885 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:13.890295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c851b-5abb-4f44-a7c9-9fb31a385885 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:13.890567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c851b-5abb-4f44-a7c9-9fb31a385885 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:13.891907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 684/1320] 10.222.0.25 () {54 vars in 965 bytes} [Sun Aug 7 18:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:13.898283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041457d-94e0-4cbc-8f38-7d858d5ac3ff None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:13.898563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041457d-94e0-4cbc-8f38-7d858d5ac3ff None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:13.898832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041457d-94e0-4cbc-8f38-7d858d5ac3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:13.920844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:13.972415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6041457d-94e0-4cbc-8f38-7d858d5ac3ff None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:13.974198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6041457d-94e0-4cbc-8f38-7d858d5ac3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:14.047234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 637/1321] 10.222.0.25 () {58 vars in 1062 bytes} [Sun Aug 7 18:12:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:14.056139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c851b-5abb-4f44-a7c9-9fb31a385885 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:14.057824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ae9c851b-5abb-4f44-a7c9-9fb31a385885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:14.165799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c851b-5abb-4f44-a7c9-9fb31a385885 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:14.240101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:14.240730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:14.241006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:14.241274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:14.242855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:14.249683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:14.349951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:14.351380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e320-a8e3-4d4b-b8af-189d74aac27b service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:14.368977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 685/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:17.491601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ed8cb-4d15-4756-aff3-e97d0d5caf25 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:17.492158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ed8cb-4d15-4756-aff3-e97d0d5caf25 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:17.492158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ed8cb-4d15-4756-aff3-e97d0d5caf25 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:17.493527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 638/1323] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:17.498619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b44ea-5775-485d-b07a-84d1c935568a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:17.499071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b44ea-5775-485d-b07a-84d1c935568a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:17.499167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b44ea-5775-485d-b07a-84d1c935568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:17.565302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-720b44ea-5775-485d-b07a-84d1c935568a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:17.566521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-720b44ea-5775-485d-b07a-84d1c935568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:17.630362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:17.673971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 686/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:17.711451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ed8cb-4d15-4756-aff3-e97d0d5caf25 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:17.713159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-760ed8cb-4d15-4756-aff3-e97d0d5caf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:17.824230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ed8cb-4d15-4756-aff3-e97d0d5caf25 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:17.836915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:17.898788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:17.899383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:17.899656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:17.899922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:17.901548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:18.007190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:18.008536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27b2a0-03f6-4180-b584-60a3b396a857 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:18.026782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 639/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:20.085773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9500-9d44-4692-be99-9b4f6d87dc3f None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.086279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9500-9d44-4692-be99-9b4f6d87dc3f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.086279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9500-9d44-4692-be99-9b4f6d87dc3f None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.087613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 687/1326] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:20.092955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3cc1-eed9-4a65-be52-023638307729 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.093343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3cc1-eed9-4a65-be52-023638307729 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.093497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3cc1-eed9-4a65-be52-023638307729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.140672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:20.159575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-579b3cc1-eed9-4a65-be52-023638307729 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:20.160822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-579b3cc1-eed9-4a65-be52-023638307729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.255969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 640/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:20.292028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a9500-9d44-4692-be99-9b4f6d87dc3f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:20.293604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-078a9500-9d44-4692-be99-9b4f6d87dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.400024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a9500-9d44-4692-be99-9b4f6d87dc3f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:20.476721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:20.477344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.477616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.477883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.479569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.498851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:20.593572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:20.595004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ace97-db4d-401a-96b4-bc3d30d7b5d8 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:20.612630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 688/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:22.701498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e23fd-ec2f-45b1-bc2d-58ce3cded727 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:22.702055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e23fd-ec2f-45b1-bc2d-58ce3cded727 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:22.702055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e23fd-ec2f-45b1-bc2d-58ce3cded727 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:22.703396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 641/1329] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:22.708953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae0b8e-8461-405d-952e-4dcf49c0d8df None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:22.709419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae0b8e-8461-405d-952e-4dcf49c0d8df None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:22.709526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae0b8e-8461-405d-952e-4dcf49c0d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:22.776714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4aae0b8e-8461-405d-952e-4dcf49c0d8df None None] MFA Rules not processed for user `cb7ed9b5bb6b47519b15cad121f36d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:22.777874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4aae0b8e-8461-405d-952e-4dcf49c0d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:22.850618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:22.883654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 689/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:22.922586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e23fd-ec2f-45b1-bc2d-58ce3cded727 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:22.924133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0a9e23fd-ec2f-45b1-bc2d-58ce3cded727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:23.025306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e23fd-ec2f-45b1-bc2d-58ce3cded727 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:23.045121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:23.101536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:23.102161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:23.102445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:23.102786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:23.104536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:23.215714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:23.217184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26e871-6f66-4149-8a48-ca4fc98c4764 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:23.235271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 642/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:25.566438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b423ba-e08b-4134-911f-8d74291db26b None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:25.567479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b423ba-e08b-4134-911f-8d74291db26b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:25.567595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b423ba-e08b-4134-911f-8d74291db26b None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:25.569176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 690/1332] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:25.574271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d518-774a-4e14-b364-112069199e67 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:25.574689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d518-774a-4e14-b364-112069199e67 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:25.574806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d518-774a-4e14-b364-112069199e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:25.637935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:25.641097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0774d518-774a-4e14-b364-112069199e67 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:25.642741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0774d518-774a-4e14-b364-112069199e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:25.737333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 643/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:25.774134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b423ba-e08b-4134-911f-8d74291db26b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:25.775723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-69b423ba-e08b-4134-911f-8d74291db26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:25.877020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b423ba-e08b-4134-911f-8d74291db26b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:25.950200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:25.950795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:25.951070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:25.951351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:25.952948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:25.978910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:26.059729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:26.061177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0b404-2b35-4626-ac4b-c047536eb840 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:26.079374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 691/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:28.115065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b9657-3a04-4c81-a019-2ca6414f7098 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:28.115569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b9657-3a04-4c81-a019-2ca6414f7098 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:28.115569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b9657-3a04-4c81-a019-2ca6414f7098 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:28.116909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 644/1335] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:12:28.122046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac504ad-70e3-44cd-8fc9-45adc3c0d161 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:28.122474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac504ad-70e3-44cd-8fc9-45adc3c0d161 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:28.122586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac504ad-70e3-44cd-8fc9-45adc3c0d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:28.189124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2ac504ad-70e3-44cd-8fc9-45adc3c0d161 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:28.190366 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2ac504ad-70e3-44cd-8fc9-45adc3c0d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:28.265420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:28.289438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 692/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:12:28.328391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b9657-3a04-4c81-a019-2ca6414f7098 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:28.329958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ca5b9657-3a04-4c81-a019-2ca6414f7098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:28.432799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b9657-3a04-4c81-a019-2ca6414f7098 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:28.461718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:28.508684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:28.509292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:28.509567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:28.509835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:28.511412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:28.623123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:28.624584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0021-f85a-405c-b0f1-e0f82b7b9abb service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:28.642541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 645/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:31.007040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918205fa-ee74-461d-9f88-11ffa63d01e7 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:31.007692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918205fa-ee74-461d-9f88-11ffa63d01e7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:31.007692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918205fa-ee74-461d-9f88-11ffa63d01e7 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:31.008937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 693/1338] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:31.013937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d73b-ab0b-4fb8-ba98-1604014102b5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:31.014342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d73b-ab0b-4fb8-ba98-1604014102b5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:31.014482 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d73b-ab0b-4fb8-ba98-1604014102b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:31.080151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b8d9d73b-ab0b-4fb8-ba98-1604014102b5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:31.081332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b8d9d73b-ab0b-4fb8-ba98-1604014102b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:31.089380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:31.174678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 646/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:31.211410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918205fa-ee74-461d-9f88-11ffa63d01e7 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:31.212959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-918205fa-ee74-461d-9f88-11ffa63d01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:31.316132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918205fa-ee74-461d-9f88-11ffa63d01e7 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:31.396543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:31.397206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:31.397522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:31.397800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:31.399478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:31.440186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:31.513044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:31.514470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c0efc-dd9d-428f-af16-57ba24e8cdf8 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:31.532643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 694/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:35.436412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb00b8-5671-4899-9ddb-ef69a8affe74 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:35.437005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb00b8-5671-4899-9ddb-ef69a8affe74 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:35.437005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb00b8-5671-4899-9ddb-ef69a8affe74 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:35.438490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 647/1341] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:35.443950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75082d8c-d2b7-4ac1-bfd6-c7955e2e88cf None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:35.444356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75082d8c-d2b7-4ac1-bfd6-c7955e2e88cf None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:35.444503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75082d8c-d2b7-4ac1-bfd6-c7955e2e88cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:35.512262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-75082d8c-d2b7-4ac1-bfd6-c7955e2e88cf None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:35.513429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-75082d8c-d2b7-4ac1-bfd6-c7955e2e88cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:35.600830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:35.613977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 695/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:35.653117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb00b8-5671-4899-9ddb-ef69a8affe74 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:35.654661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffeb00b8-5671-4899-9ddb-ef69a8affe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:35.760275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb00b8-5671-4899-9ddb-ef69a8affe74 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:35.797128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:35.833625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:35.834225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:35.834496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:35.834758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:35.836323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:35.943518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:35.944976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a8f66-3620-426f-bcd1-0ef5b6eb4ecc service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:35.962517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 648/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:38.718603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e256-2857-43bf-9555-b403fdc3780c None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:38.719153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e256-2857-43bf-9555-b403fdc3780c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:38.719153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e256-2857-43bf-9555-b403fdc3780c None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:38.720466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 696/1344] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:38.726390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe2266-9c0f-40b6-84c4-1268b872f056 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:38.726866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe2266-9c0f-40b6-84c4-1268b872f056 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:38.727393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe2266-9c0f-40b6-84c4-1268b872f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:38.799285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fdfe2266-9c0f-40b6-84c4-1268b872f056 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:38.803353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fdfe2266-9c0f-40b6-84c4-1268b872f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:38.820330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:38.899058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 649/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:38.937457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e256-2857-43bf-9555-b403fdc3780c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:38.939114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-24e9e256-2857-43bf-9555-b403fdc3780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:39.044311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e256-2857-43bf-9555-b403fdc3780c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:39.117728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:39.118333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:39.118610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:39.118880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:39.120466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:39.166120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:39.233606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:39.235048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fd28f-c0fb-4761-a148-ccbc0e660741 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:39.254088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 697/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:43.213874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117742d3-bc3d-42f5-b98f-35a769f8a92a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:43.214440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117742d3-bc3d-42f5-b98f-35a769f8a92a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:43.214440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117742d3-bc3d-42f5-b98f-35a769f8a92a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:43.215755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 650/1347] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:43.221129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd21b75-14bd-4663-bcea-8c22b839029b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:43.221592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd21b75-14bd-4663-bcea-8c22b839029b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:43.221827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd21b75-14bd-4663-bcea-8c22b839029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:43.289863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4fd21b75-14bd-4663-bcea-8c22b839029b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:43.290995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4fd21b75-14bd-4663-bcea-8c22b839029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:43.390459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:43.393208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 698/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:43.435081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117742d3-bc3d-42f5-b98f-35a769f8a92a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:43.436891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-117742d3-bc3d-42f5-b98f-35a769f8a92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:43.558869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117742d3-bc3d-42f5-b98f-35a769f8a92a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:43.609202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:43.637548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:43.638142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:43.638418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:43.638688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:43.640289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:43.753792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:43.756016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721372b6-9f3d-4693-80a6-57526cecd3c4 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:43.774981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 651/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:48.694507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4d15b-3e43-4376-8596-789ff8350c53 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:48.695430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4d15b-3e43-4376-8596-789ff8350c53 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:48.696095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4d15b-3e43-4376-8596-789ff8350c53 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:48.698467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 699/1350] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:12:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:48.719516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf621-c052-4124-ad4b-726ccda39f71 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:48.720649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf621-c052-4124-ad4b-726ccda39f71 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:48.721185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddf621-c052-4124-ad4b-726ccda39f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:48.848674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9dddf621-c052-4124-ad4b-726ccda39f71 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:48.849890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9dddf621-c052-4124-ad4b-726ccda39f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:48.869916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:48.970578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 652/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:53.190057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7851e-8eb0-4da8-b81e-4133cb95b284 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:53.190978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7851e-8eb0-4da8-b81e-4133cb95b284 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:53.191784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7851e-8eb0-4da8-b81e-4133cb95b284 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:53.193252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 700/1352] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:53.198500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ee32-d361-4946-9ffd-9def8e2db2cd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:53.198937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ee32-d361-4946-9ffd-9def8e2db2cd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:53.199087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ee32-d361-4946-9ffd-9def8e2db2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:53.279346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b254ee32-d361-4946-9ffd-9def8e2db2cd None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:53.280579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b254ee32-d361-4946-9ffd-9def8e2db2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:53.354151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:53.391977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 653/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:54.740127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328ceb-0f61-4cad-b0af-658f771e8058 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:54.740673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328ceb-0f61-4cad-b0af-658f771e8058 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:54.740673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328ceb-0f61-4cad-b0af-658f771e8058 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:54.742011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 701/1354] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:54.746961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e84e-4bcf-4ca1-8af2-d9e4e8ef3459 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:54.747371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e84e-4bcf-4ca1-8af2-d9e4e8ef3459 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:54.747654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e84e-4bcf-4ca1-8af2-d9e4e8ef3459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:54.827302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-34f6e84e-4bcf-4ca1-8af2-d9e4e8ef3459 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:54.828497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-34f6e84e-4bcf-4ca1-8af2-d9e4e8ef3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:54.934222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 654/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:12:58.316891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68b52-57c2-486e-ab3e-ae123255c44e None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:58.317414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68b52-57c2-486e-ab3e-ae123255c44e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:58.317494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68b52-57c2-486e-ab3e-ae123255c44e None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:58.318909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 702/1356] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:58.324919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb21c-b3df-459b-b7ac-d6588357e02b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:58.325376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb21c-b3df-459b-b7ac-d6588357e02b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:58.325463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb21c-b3df-459b-b7ac-d6588357e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:58.376450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:58.419488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ff4cb21c-b3df-459b-b7ac-d6588357e02b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:58.420815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ff4cb21c-b3df-459b-b7ac-d6588357e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:58.529746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 655/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:58.588319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2bbe5-3bb3-4a02-850c-2cea5bd51e07 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:58.588902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2bbe5-3bb3-4a02-850c-2cea5bd51e07 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:58.589657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2bbe5-3bb3-4a02-850c-2cea5bd51e07 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:58.591451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 703/1358] 10.222.0.25 () {54 vars in 962 bytes} [Sun Aug 7 18:12:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:58.600384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d36c-5fcc-45cd-a87c-66299ad116b4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:58.600810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d36c-5fcc-45cd-a87c-66299ad116b4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:58.601068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d36c-5fcc-45cd-a87c-66299ad116b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:58.685459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c3e6d36c-5fcc-45cd-a87c-66299ad116b4 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:58.686649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3e6d36c-5fcc-45cd-a87c-66299ad116b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:58.739304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:58.818509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 656/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Sun Aug 7 18:12:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:58.826532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2bbe5-3bb3-4a02-850c-2cea5bd51e07 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:58.828212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6bb2bbe5-3bb3-4a02-850c-2cea5bd51e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:58.985402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2bbe5-3bb3-4a02-850c-2cea5bd51e07 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:59.064704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:59.107064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:59.107670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:59.107944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:59.108210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:59.109804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:59.205135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:59.207537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f28ac-d627-446c-8c91-38ba91834a11 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:59.227655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 704/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:01.480215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cfc41-7035-4db8-8766-acb94a141043 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:01.480700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cfc41-7035-4db8-8766-acb94a141043 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:01.481091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cfc41-7035-4db8-8766-acb94a141043 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:01.482427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 657/1361] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:13:01.487454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1113-13cc-4e99-9910-9ca6ffdc88eb None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:01.487958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1113-13cc-4e99-9910-9ca6ffdc88eb None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:01.487958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1113-13cc-4e99-9910-9ca6ffdc88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:01.557588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9b8b1113-13cc-4e99-9910-9ca6ffdc88eb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:01.558705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9b8b1113-13cc-4e99-9910-9ca6ffdc88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:01.596209 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:01.665488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 705/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:01.709924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cfc41-7035-4db8-8766-acb94a141043 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:01.711363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-790cfc41-7035-4db8-8766-acb94a141043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:01.879251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cfc41-7035-4db8-8766-acb94a141043 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:01.889136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:02.012601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:02.012961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:02.013269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:02.013573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:02.015044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:02.110986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:02.112807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9c019-24e9-4809-b8c3-7e0c4ef174a8 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:02.132625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 658/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:04.488528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040acab-b3ed-44b1-a968-183e303e843f None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:04.489637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040acab-b3ed-44b1-a968-183e303e843f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:04.490177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040acab-b3ed-44b1-a968-183e303e843f None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:04.492027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 706/1364] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:04.498997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446416ad-eb14-4c74-ad52-1a3caa7fc5cd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:04.499538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446416ad-eb14-4c74-ad52-1a3caa7fc5cd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:04.499665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446416ad-eb14-4c74-ad52-1a3caa7fc5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:04.519164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:04.578706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-446416ad-eb14-4c74-ad52-1a3caa7fc5cd None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:04.579936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-446416ad-eb14-4c74-ad52-1a3caa7fc5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:04.690037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 659/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:04.741716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522083-a8f9-4d94-a573-7ba478d44ba2 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:04.742266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522083-a8f9-4d94-a573-7ba478d44ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:04.742756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522083-a8f9-4d94-a573-7ba478d44ba2 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:04.744263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 707/1366] 10.222.0.25 () {54 vars in 962 bytes} [Sun Aug 7 18:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:04.753215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d8e3-283f-4b8e-8f3b-3718d04ea1a2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:04.754472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d8e3-283f-4b8e-8f3b-3718d04ea1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:04.755000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d8e3-283f-4b8e-8f3b-3718d04ea1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:04.840011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7269d8e3-283f-4b8e-8f3b-3718d04ea1a2 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:04.841416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7269d8e3-283f-4b8e-8f3b-3718d04ea1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:04.877606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:04.967263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 660/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Sun Aug 7 18:13:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:04.975274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522083-a8f9-4d94-a573-7ba478d44ba2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:04.976906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cd522083-a8f9-4d94-a573-7ba478d44ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:05.168697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522083-a8f9-4d94-a573-7ba478d44ba2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:05.190340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:05.291948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:05.292746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:05.293125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:05.293493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:05.295213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:05.390850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:05.392654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079a3d3-bea3-4146-b7d9-0f4d7a039751 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:05.413813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 708/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:13:06.433322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d906f-66f1-47cb-a47c-27aeb86bc14d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:06.433848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d906f-66f1-47cb-a47c-27aeb86bc14d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:06.433848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d906f-66f1-47cb-a47c-27aeb86bc14d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:06.435275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 661/1369] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:06.440203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430d5c-791d-4f07-8a7a-8db3f5bed852 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:06.440671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430d5c-791d-4f07-8a7a-8db3f5bed852 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:06.440763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430d5c-791d-4f07-8a7a-8db3f5bed852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:06.474612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:06.510059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-42430d5c-791d-4f07-8a7a-8db3f5bed852 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:06.511267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-42430d5c-791d-4f07-8a7a-8db3f5bed852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:06.618000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 709/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:06.930383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab44b7-e8ee-43dd-9b35-e508d1bbfa14 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:06.930803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab44b7-e8ee-43dd-9b35-e508d1bbfa14 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:06.931177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab44b7-e8ee-43dd-9b35-e508d1bbfa14 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:06.932748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 662/1371] 10.222.0.25 () {54 vars in 964 bytes} [Sun Aug 7 18:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:06.937982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e12a-7364-4551-bf02-432a7d119222 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:06.938267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e12a-7364-4551-bf02-432a7d119222 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:06.938539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4e12a-7364-4551-bf02-432a7d119222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:07.018673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6eb4e12a-7364-4551-bf02-432a7d119222 None None] MFA Rules not processed for user `9ab6c2c2f06040d09952c23e76d2c8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:07.020600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6eb4e12a-7364-4551-bf02-432a7d119222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:07.072956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:07.106185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 710/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Sun Aug 7 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:07.114401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab44b7-e8ee-43dd-9b35-e508d1bbfa14 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:07.115900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c4ab44b7-e8ee-43dd-9b35-e508d1bbfa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:07.225796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab44b7-e8ee-43dd-9b35-e508d1bbfa14 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:07.270401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:07.305101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:07.305708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:07.305980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:07.306244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:07.307814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:07.423079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:07.424454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eb426-6e74-4f89-86a7-23e245747482 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:07.444553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 663/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:07.536665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715a43-da56-4eb7-838a-009fb5309b56 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:07.537115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715a43-da56-4eb7-838a-009fb5309b56 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:07.537329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715a43-da56-4eb7-838a-009fb5309b56 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:07.538700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 711/1374] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:07.550335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b053-8eb1-40de-932c-3de0d93bd881 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:07.550957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b053-8eb1-40de-932c-3de0d93bd881 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:07.551227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b053-8eb1-40de-932c-3de0d93bd881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:07.622318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c1e4b053-8eb1-40de-932c-3de0d93bd881 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:07.623569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1e4b053-8eb1-40de-932c-3de0d93bd881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:07.650454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:07.742960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 664/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:07.789459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715a43-da56-4eb7-838a-009fb5309b56 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:07.791297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8a715a43-da56-4eb7-838a-009fb5309b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:07.973950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715a43-da56-4eb7-838a-009fb5309b56 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:08.024779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:08.095350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:08.095958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:08.096234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:08.096504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:08.099060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:08.190787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:08.193122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc51ef-9844-4008-b1af-8fa23e8b2642 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:08.216745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 712/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:10.236917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9e8e9-87e0-4a21-b18c-5f0614085c49 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:10.237453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9e8e9-87e0-4a21-b18c-5f0614085c49 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:10.237453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9e8e9-87e0-4a21-b18c-5f0614085c49 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:10.239422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 665/1377] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:10.244862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9611-3dac-446c-88e6-f8cbbf0812af None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:10.245271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9611-3dac-446c-88e6-f8cbbf0812af None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:10.245410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee9611-3dac-446c-88e6-f8cbbf0812af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:10.318671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f5ee9611-3dac-446c-88e6-f8cbbf0812af None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:10.319920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f5ee9611-3dac-446c-88e6-f8cbbf0812af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:10.326575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:10.424091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 713/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:10.471222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9e8e9-87e0-4a21-b18c-5f0614085c49 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:10.473304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9bd9e8e9-87e0-4a21-b18c-5f0614085c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:10.632599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9e8e9-87e0-4a21-b18c-5f0614085c49 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:10.636096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:10.746221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:10.746811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:10.747088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:10.747358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:10.748993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:10.851664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:10.853312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c41d7d-40d0-4fad-ba90-9984925be9a0 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:10.873751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 666/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:12.979595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8ded-1887-4c63-a7bc-d9158b89c608 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:12.980217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8ded-1887-4c63-a7bc-d9158b89c608 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:12.980217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8ded-1887-4c63-a7bc-d9158b89c608 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:12.981645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 714/1380] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:12.986730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9705a-3236-4ad7-a008-0bdf2299b5c7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:12.987148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9705a-3236-4ad7-a008-0bdf2299b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:12.987344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9705a-3236-4ad7-a008-0bdf2299b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:12.999909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:13.069688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c9a9705a-3236-4ad7-a008-0bdf2299b5c7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:13.071128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c9a9705a-3236-4ad7-a008-0bdf2299b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:13.179949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 667/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:13.224078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8ded-1887-4c63-a7bc-d9158b89c608 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:13.225658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b91c8ded-1887-4c63-a7bc-d9158b89c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:13.375986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:13.389057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8ded-1887-4c63-a7bc-d9158b89c608 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:13.511994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:13.512754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:13.513038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:13.513648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:13.515278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:13.611160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:13.612940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152cfc-ae32-40eb-b8b3-fcf33a623cec service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:13.624158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:13.635035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 715/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:15.773894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8d39-2d7e-4d4b-a0dd-d8aace956b6b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:15.774432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8d39-2d7e-4d4b-a0dd-d8aace956b6b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:15.774630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8d39-2d7e-4d4b-a0dd-d8aace956b6b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:15.776313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 668/1383] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:15.781895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e3f04-dc0e-4d74-8a61-247fc6fc3157 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:15.782323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e3f04-dc0e-4d74-8a61-247fc6fc3157 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:15.782417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e3f04-dc0e-4d74-8a61-247fc6fc3157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:15.857456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c39e3f04-dc0e-4d74-8a61-247fc6fc3157 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:15.858684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c39e3f04-dc0e-4d74-8a61-247fc6fc3157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:15.962751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 716/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:16.006010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8d39-2d7e-4d4b-a0dd-d8aace956b6b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:16.007537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-765d8d39-2d7e-4d4b-a0dd-d8aace956b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:16.098547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:16.173775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8d39-2d7e-4d4b-a0dd-d8aace956b6b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:16.302000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:16.302839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:16.303198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:16.303552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:16.305668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:16.359116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:16.401348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:16.402940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b9a9f-1539-4f12-9571-175719899eba service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:16.422258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 669/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:19.094384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871cb4-58d3-4d94-87d1-a1314f8df433 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:19.094912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871cb4-58d3-4d94-87d1-a1314f8df433 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:19.094912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76871cb4-58d3-4d94-87d1-a1314f8df433 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:19.096497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 717/1386] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:19.103100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887627-969d-433f-b76d-893946d03844 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:19.103682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887627-969d-433f-b76d-893946d03844 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:19.103682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02887627-969d-433f-b76d-893946d03844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:19.169763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-02887627-969d-433f-b76d-893946d03844 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:19.170930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-02887627-969d-433f-b76d-893946d03844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:19.267813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 670/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:19.312223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871cb4-58d3-4d94-87d1-a1314f8df433 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:19.313790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-76871cb4-58d3-4d94-87d1-a1314f8df433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:19.391653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:19.476865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76871cb4-58d3-4d94-87d1-a1314f8df433 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:19.608729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:19.609339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:19.609616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:19.609891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:19.611482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:19.657062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:19.712028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:19.713685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfbcb2-3783-4343-a837-a626898a78f9 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:19.732835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 718/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:21.806963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb99c-7060-404a-ad21-e4cc61027751 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:21.807462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb99c-7060-404a-ad21-e4cc61027751 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:21.807545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb99c-7060-404a-ad21-e4cc61027751 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:21.808884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 671/1389] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:21.813924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bf15-6071-4879-8f37-6eac2939802d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:21.814350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bf15-6071-4879-8f37-6eac2939802d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:21.814477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bf15-6071-4879-8f37-6eac2939802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:21.879911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b617bf15-6071-4879-8f37-6eac2939802d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:21.881122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b617bf15-6071-4879-8f37-6eac2939802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:21.976597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 719/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:22.020902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb99c-7060-404a-ad21-e4cc61027751 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:22.022420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-faaeb99c-7060-404a-ad21-e4cc61027751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.054751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:22.175374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb99c-7060-404a-ad21-e4cc61027751 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:22.282897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:22.295808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:22.296416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.296723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.296993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.298580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.398880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:22.400395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a70235-aab2-48fb-8b6e-f32567169009 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:22.420406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 672/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:22.591806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce1db-d592-44ce-8503-00e3103c445a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.592207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce1db-d592-44ce-8503-00e3103c445a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.592487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce1db-d592-44ce-8503-00e3103c445a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.593904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 720/1392] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:22.600540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557bbb-d1bf-412b-ad38-fe5e3124e89b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.600852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557bbb-d1bf-412b-ad38-fe5e3124e89b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.601123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557bbb-d1bf-412b-ad38-fe5e3124e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.670085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e0557bbb-d1bf-412b-ad38-fe5e3124e89b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:22.671778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e0557bbb-d1bf-412b-ad38-fe5e3124e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.731003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:22.771182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 673/1393] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:22.827273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3ba44-34ff-457e-a426-20a1753977fa None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.827707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3ba44-34ff-457e-a426-20a1753977fa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.827955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3ba44-34ff-457e-a426-20a1753977fa None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.829363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 721/1394] 10.222.0.25 () {54 vars in 966 bytes} [Sun Aug 7 18:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:22.835465 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e2ec-b60b-4927-ad84-8c6b3c3a3be4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.835862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e2ec-b60b-4927-ad84-8c6b3c3a3be4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.836005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e2ec-b60b-4927-ad84-8c6b3c3a3be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.911847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-92d3e2ec-b60b-4927-ad84-8c6b3c3a3be4 None None] MFA Rules not processed for user `d8ab184b2ae0437d9fb01eac225baf06`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:22.913097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-92d3e2ec-b60b-4927-ad84-8c6b3c3a3be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.994043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 674/1395] 10.222.0.25 () {58 vars in 1063 bytes} [Sun Aug 7 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:23.001751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3ba44-34ff-457e-a426-20a1753977fa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:23.003327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-77f3ba44-34ff-457e-a426-20a1753977fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:23.016926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:23.110827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3ba44-34ff-457e-a426-20a1753977fa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:23.184182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:23.184819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:23.185095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:23.185361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:23.186942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:23.255105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:23.297184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:23.298608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0324ef-1f94-48cd-99a8-0bbc2b3da866 service glance] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:23.318933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 722/1396] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:24.048405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33cfa-d625-490d-ac51-22a73b76761e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.048936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33cfa-d625-490d-ac51-22a73b76761e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.049153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33cfa-d625-490d-ac51-22a73b76761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.117419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c0e33cfa-d625-490d-ac51-22a73b76761e None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:24.118623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c0e33cfa-d625-490d-ac51-22a73b76761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:24.126828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:24.205397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 675/1397] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:13:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:24.253730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715b4e-2632-4248-bc22-8c3be89db834 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.254291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715b4e-2632-4248-bc22-8c3be89db834 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.254387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715b4e-2632-4248-bc22-8c3be89db834 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.255826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 723/1398] 10.222.0.25 () {54 vars in 943 bytes} [Sun Aug 7 18:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:24.262422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9276f4-611e-43c8-bcf9-8fe14bcb03b6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.262777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9276f4-611e-43c8-bcf9-8fe14bcb03b6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.263107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9276f4-611e-43c8-bcf9-8fe14bcb03b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.339034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3e9276f4-611e-43c8-bcf9-8fe14bcb03b6 None None] MFA Rules not processed for user `eb23346704d74ab8aea1a295ab75cde8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:24.340173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3e9276f4-611e-43c8-bcf9-8fe14bcb03b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:24.425546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:24.448038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 676/1399] 10.222.0.25 () {58 vars in 1040 bytes} [Sun Aug 7 18:13:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:24.457891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715b4e-2632-4248-bc22-8c3be89db834 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:24.459418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ad715b4e-2632-4248-bc22-8c3be89db834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:24.468918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db60d65-6e97-489b-90cd-7fbeb01aa0f9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.469324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db60d65-6e97-489b-90cd-7fbeb01aa0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.469605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db60d65-6e97-489b-90cd-7fbeb01aa0f9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.470958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 677/1400] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:24.476665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.476952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.477225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.548066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:24.549318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:24.604217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715b4e-2632-4248-bc22-8c3be89db834 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:24.641818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:24.651679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 678/1401] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:24.697988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:24.699180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:24.711362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:24.711973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.712254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.712546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.714258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:24.767258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:24.804429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:24.806142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7dd58-010a-4c10-9317-07090b3ca777 service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:24.814446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 724/1402] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:13:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 18:13:24.819388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e33f0-aed4-4348-9f85-445e33c1a7df None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:24.963098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:24.963724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:24.964036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:24.964318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:24.966003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:25.028692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:25.063048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:25.068959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed2992-682e-47e0-81db-eda27d63e5d6 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:25.088745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 679/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:13:27.156206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb56e1d-216c-4f92-b970-ddb4b4c2128b None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:27.156789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb56e1d-216c-4f92-b970-ddb4b4c2128b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:27.156789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb56e1d-216c-4f92-b970-ddb4b4c2128b None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:27.158031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 725/1404] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:27.163904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39f86-17c4-4e2b-bfd6-2a71f1906cf8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:27.164377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39f86-17c4-4e2b-bfd6-2a71f1906cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:27.164483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b39f86-17c4-4e2b-bfd6-2a71f1906cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:27.235524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c4b39f86-17c4-4e2b-bfd6-2a71f1906cf8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:27.236780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c4b39f86-17c4-4e2b-bfd6-2a71f1906cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:27.348610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 680/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:27.389794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb56e1d-216c-4f92-b970-ddb4b4c2128b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:27.391520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8eb56e1d-216c-4f92-b970-ddb4b4c2128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:27.488683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:27.569118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb56e1d-216c-4f92-b970-ddb4b4c2128b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:27.697876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:27.698482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:27.698753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:27.699017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:27.700649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:27.732729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:27.803197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:27.805242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11825f-3610-4e35-9e3f-ecd021773a0d service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:27.825324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 726/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:29.878108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e5e02-2ac6-428c-bef4-1a4fc4c1148d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:29.878683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e5e02-2ac6-428c-bef4-1a4fc4c1148d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:29.878683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e5e02-2ac6-428c-bef4-1a4fc4c1148d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:29.880148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 681/1407] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:29.885344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7099-ee9b-4717-b6ba-e39551d26a32 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:29.885771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7099-ee9b-4717-b6ba-e39551d26a32 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:29.885941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7099-ee9b-4717-b6ba-e39551d26a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:29.958837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-200b7099-ee9b-4717-b6ba-e39551d26a32 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:29.960100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-200b7099-ee9b-4717-b6ba-e39551d26a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:30.069228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 727/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:30.114382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e5e02-2ac6-428c-bef4-1a4fc4c1148d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:30.115946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a96e5e02-2ac6-428c-bef4-1a4fc4c1148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:30.157006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:30.292168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e5e02-2ac6-428c-bef4-1a4fc4c1148d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:30.420210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:30.426833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:30.427901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:30.428258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:30.428636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:30.430365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:30.527387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:30.529064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e29b28-8175-472e-a390-45fc386ae779 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:30.548484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 682/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:13:40.067165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:40.545869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=47 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:47.422049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f12bf-ae80-4828-99f2-95b00f1a66bf None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:47.422651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f12bf-ae80-4828-99f2-95b00f1a66bf None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:47.422651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f12bf-ae80-4828-99f2-95b00f1a66bf None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:47.424499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 728/1410] 10.222.0.25 () {54 vars in 918 bytes} [Sun Aug 7 18:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:47.429602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3e65-3d98-449f-b237-9572725c0211 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:47.430032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3e65-3d98-449f-b237-9572725c0211 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:47.430134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3e65-3d98-449f-b237-9572725c0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:47.503220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e72d3e65-3d98-449f-b237-9572725c0211 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:47.504417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e72d3e65-3d98-449f-b237-9572725c0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:47.607170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 683/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Aug 7 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:47.621730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c04cb-7238-4049-9107-4e938244c7c1 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:47.622016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c04cb-7238-4049-9107-4e938244c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:47.622289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c04cb-7238-4049-9107-4e938244c7c1 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:47.623640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 729/1412] 10.222.0.25 () {54 vars in 918 bytes} [Sun Aug 7 18:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:47.628407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb013d-9d41-4bd4-b498-487a3634023c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:47.628719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb013d-9d41-4bd4-b498-487a3634023c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:47.628989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb013d-9d41-4bd4-b498-487a3634023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:47.699966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:47.704176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a3fb013d-9d41-4bd4-b498-487a3634023c None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:47.706708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a3fb013d-9d41-4bd4-b498-487a3634023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:47.820924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 684/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Aug 7 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:50.278784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98a63-5d7a-4399-b417-2d03f7085462 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:50.279314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98a63-5d7a-4399-b417-2d03f7085462 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:50.279314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98a63-5d7a-4399-b417-2d03f7085462 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:50.281077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 730/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:50.287464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00dc1-d06e-4d41-88d1-82365d3f5623 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:50.287934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00dc1-d06e-4d41-88d1-82365d3f5623 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:50.288117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00dc1-d06e-4d41-88d1-82365d3f5623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:50.355398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-aaa00dc1-d06e-4d41-88d1-82365d3f5623 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:50.356633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aaa00dc1-d06e-4d41-88d1-82365d3f5623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:50.412186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:50.453924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 685/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:50.499650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98a63-5d7a-4399-b417-2d03f7085462 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:50.501399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0cf98a63-5d7a-4399-b417-2d03f7085462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:50.651686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98a63-5d7a-4399-b417-2d03f7085462 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:50.723298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:50.763089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:50.763682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:50.763954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:50.764226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:50.765822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:50.856058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:50.857700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e9cc8-539b-469c-acda-859b364d1613 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:50.875362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 731/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:51.804825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f791-b1ed-4190-9fab-e834bf95b13c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:51.805369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f791-b1ed-4190-9fab-e834bf95b13c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:51.805511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f791-b1ed-4190-9fab-e834bf95b13c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:51.806947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 686/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:51.812680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171e9c8-8b27-495f-b48c-c8d37488252d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:51.813127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171e9c8-8b27-495f-b48c-c8d37488252d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:51.813229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171e9c8-8b27-495f-b48c-c8d37488252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:51.900356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e171e9c8-8b27-495f-b48c-c8d37488252d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:51.901582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e171e9c8-8b27-495f-b48c-c8d37488252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:51.931188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:52.001042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 732/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:52.150289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f791-b1ed-4190-9fab-e834bf95b13c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:52.151723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8aa7f791-b1ed-4190-9fab-e834bf95b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:52.297573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f791-b1ed-4190-9fab-e834bf95b13c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:52.337666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:52.410699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:52.411217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:52.411488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:52.411754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:52.413358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:52.500960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:52.503164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790750-d781-40cc-a222-d98bd930f742 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:52.521587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 687/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:53.399310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfe749-69e0-44f5-8961-63a5a2f98f17 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:53.399858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfe749-69e0-44f5-8961-63a5a2f98f17 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:53.399858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfe749-69e0-44f5-8961-63a5a2f98f17 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:53.401227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 733/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:53.406278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1d27-7f84-4e28-af3c-290724e8c0d1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:53.406712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1d27-7f84-4e28-af3c-290724e8c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:53.406808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1d27-7f84-4e28-af3c-290724e8c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:53.459908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:53.481427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dbeb1d27-7f84-4e28-af3c-290724e8c0d1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:53.482636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dbeb1d27-7f84-4e28-af3c-290724e8c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:53.577526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 688/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:53.730823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfe749-69e0-44f5-8961-63a5a2f98f17 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:53.732342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-76cfe749-69e0-44f5-8961-63a5a2f98f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:53.882416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfe749-69e0-44f5-8961-63a5a2f98f17 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:53.895036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:53.994788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:53.995339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:53.995608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:53.995871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:53.997483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:54.086606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:54.088185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb8cd4-dd41-48c9-a3ea-106734d5a078 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:54.105813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 734/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:54.963672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59ed38-73ea-40b8-942c-6de909f4ba47 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:54.964261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59ed38-73ea-40b8-942c-6de909f4ba47 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:54.964261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59ed38-73ea-40b8-942c-6de909f4ba47 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:54.965639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 689/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:54.971003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef891616-7619-4758-b5ad-1da8fca3443e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:54.971426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef891616-7619-4758-b5ad-1da8fca3443e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:54.971618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef891616-7619-4758-b5ad-1da8fca3443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:54.991917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:55.049159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ef891616-7619-4758-b5ad-1da8fca3443e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:55.050291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ef891616-7619-4758-b5ad-1da8fca3443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:55.143811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 735/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:55.299377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59ed38-73ea-40b8-942c-6de909f4ba47 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:55.300819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2f59ed38-73ea-40b8-942c-6de909f4ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:55.409828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:55.445980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59ed38-73ea-40b8-942c-6de909f4ba47 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:55.555366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:55.555888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:55.556158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:55.556419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:55.558020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:55.632428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:55.646567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:55.648164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6250-e3cb-4105-9af7-1abd9aecfbb9 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:55.665830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 690/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:56.522697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d94-e8b9-41cd-81d3-6113a85161c0 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:56.523252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d94-e8b9-41cd-81d3-6113a85161c0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:56.523252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d94-e8b9-41cd-81d3-6113a85161c0 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:56.524553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 736/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:56.529377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701e49-2ac5-4d17-aa2c-bb34d8d9b391 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:56.529818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701e49-2ac5-4d17-aa2c-bb34d8d9b391 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:56.529914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701e49-2ac5-4d17-aa2c-bb34d8d9b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:56.603987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-70701e49-2ac5-4d17-aa2c-bb34d8d9b391 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:56.605135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-70701e49-2ac5-4d17-aa2c-bb34d8d9b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:56.699265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 691/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:56.849509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544d94-e8b9-41cd-81d3-6113a85161c0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:56.851054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-eb544d94-e8b9-41cd-81d3-6113a85161c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:57.056271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:57.117995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544d94-e8b9-41cd-81d3-6113a85161c0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:57.236037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:57.236676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:57.236930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:57.237200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:57.239037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:57.285631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:57.327538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:57.329082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efece63-7b4b-4986-9da8-321c2f59b3c3 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:57.347394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 737/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:58.148877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e40540-5a16-48c0-8719-e595c03a93ac None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:58.149488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e40540-5a16-48c0-8719-e595c03a93ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:58.149488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e40540-5a16-48c0-8719-e595c03a93ac None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:58.150732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 692/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:58.156097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708123-e56a-464b-97ea-8d09275f633d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:58.156552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708123-e56a-464b-97ea-8d09275f633d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:58.156685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708123-e56a-464b-97ea-8d09275f633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:58.230840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-98708123-e56a-464b-97ea-8d09275f633d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:58.232029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-98708123-e56a-464b-97ea-8d09275f633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:58.326765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 738/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:58.481082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e40540-5a16-48c0-8719-e595c03a93ac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:58.482580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a0e40540-5a16-48c0-8719-e595c03a93ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:58.530187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:58.628156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e40540-5a16-48c0-8719-e595c03a93ac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:58.739214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:58.739740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:58.740013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:58.740301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:58.741904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:58.748689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:58.832167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:58.833848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07032eb9-c621-4075-b55f-f83f2a55efc1 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:58.851919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 693/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:59.674362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06221a-a6e7-4343-9a7c-64f37774e2ca None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:59.674937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06221a-a6e7-4343-9a7c-64f37774e2ca None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:59.674937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06221a-a6e7-4343-9a7c-64f37774e2ca None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:59.676198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 739/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:59.681134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae7e1-038b-44f9-b33a-fdaf55c3d9b3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:59.681560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae7e1-038b-44f9-b33a-fdaf55c3d9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:59.681676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae7e1-038b-44f9-b33a-fdaf55c3d9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:59.757401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-656ae7e1-038b-44f9-b33a-fdaf55c3d9b3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:59.758601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-656ae7e1-038b-44f9-b33a-fdaf55c3d9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:59.826411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:59.855140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 694/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:00.006204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06221a-a6e7-4343-9a7c-64f37774e2ca None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:00.007716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bf06221a-a6e7-4343-9a7c-64f37774e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:00.025611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:00.151788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06221a-a6e7-4343-9a7c-64f37774e2ca None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:00.239138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:00.264929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:00.265464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:00.265738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:00.266005 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:00.268432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:00.364067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:00.365689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a510-be37-4fc8-b0ec-fd4bfca6c05c service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:00.383437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 740/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:01.185886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cdced-bd33-4cc0-96d0-4ecd8d25615b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:01.186443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cdced-bd33-4cc0-96d0-4ecd8d25615b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:01.186443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cdced-bd33-4cc0-96d0-4ecd8d25615b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:01.187756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 695/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:01.193147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5645-888c-41ed-aa2c-158db6cbf0e7 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:01.193614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5645-888c-41ed-aa2c-158db6cbf0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:01.193726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5645-888c-41ed-aa2c-158db6cbf0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:01.267787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-abad5645-888c-41ed-aa2c-158db6cbf0e7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:01.269003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-abad5645-888c-41ed-aa2c-158db6cbf0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:01.312398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:01.376671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 741/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:01.526325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cdced-bd33-4cc0-96d0-4ecd8d25615b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:01.527836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f4cdced-bd33-4cc0-96d0-4ecd8d25615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:01.674367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cdced-bd33-4cc0-96d0-4ecd8d25615b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:01.727045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:01.786608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:01.787117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:01.787389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:01.787654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:01.789266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:01.876804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:01.878406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0ad1-663f-4b08-9bc0-f349f696af8d service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:01.896378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 696/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:02.699404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084a6dd-54e1-4717-a7b7-0cd06bb2b958 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:02.699922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084a6dd-54e1-4717-a7b7-0cd06bb2b958 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:02.699922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084a6dd-54e1-4717-a7b7-0cd06bb2b958 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:02.701227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 742/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:02.706414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04722ce-e45f-49e8-80b0-5bdc5122f225 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:02.706844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04722ce-e45f-49e8-80b0-5bdc5122f225 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:02.706970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04722ce-e45f-49e8-80b0-5bdc5122f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:02.780895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c04722ce-e45f-49e8-80b0-5bdc5122f225 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:02.782110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c04722ce-e45f-49e8-80b0-5bdc5122f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:02.784186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:02.881932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 697/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:03.035576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084a6dd-54e1-4717-a7b7-0cd06bb2b958 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:03.037119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8084a6dd-54e1-4717-a7b7-0cd06bb2b958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:03.186096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084a6dd-54e1-4717-a7b7-0cd06bb2b958 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:03.213001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:03.300156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:03.300714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:03.300993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:03.301278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:03.302848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:03.389999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:03.392072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247cf8e-5dc0-4529-9d75-ef3a30291e96 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:03.411774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 743/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:05.330580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a7d1-9a2c-4b72-a0fb-ba7d6dbae738 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:05.331144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a7d1-9a2c-4b72-a0fb-ba7d6dbae738 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:05.331144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a7d1-9a2c-4b72-a0fb-ba7d6dbae738 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:05.332481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 698/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:05.337691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28e65a-4c45-495d-8a2f-fa4e84e2c8d8 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:05.338101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28e65a-4c45-495d-8a2f-fa4e84e2c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:05.338226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28e65a-4c45-495d-8a2f-fa4e84e2c8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:05.379677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:05.404871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5c28e65a-4c45-495d-8a2f-fa4e84e2c8d8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:05.406324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5c28e65a-4c45-495d-8a2f-fa4e84e2c8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:05.504264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 744/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:05.543178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672a7d1-9a2c-4b72-a0fb-ba7d6dbae738 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:05.544793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6672a7d1-9a2c-4b72-a0fb-ba7d6dbae738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:05.648127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672a7d1-9a2c-4b72-a0fb-ba7d6dbae738 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:05.680790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:05.722944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:05.723548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:05.723828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:05.724099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:05.725719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:05.834125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:05.835551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea3e5-981e-405a-9795-2faed0e81720 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:05.853988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 699/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:08.069764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b0e4-3bbd-496d-964b-c88bb9015113 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:08.070270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b0e4-3bbd-496d-964b-c88bb9015113 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:08.070270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b0e4-3bbd-496d-964b-c88bb9015113 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:08.071559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 745/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:08.076675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5150-fcaf-487a-82cd-eb0d3eb67f93 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:08.077107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5150-fcaf-487a-82cd-eb0d3eb67f93 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:08.077210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5150-fcaf-487a-82cd-eb0d3eb67f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:08.142036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9b5e5150-fcaf-487a-82cd-eb0d3eb67f93 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:08.143226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9b5e5150-fcaf-487a-82cd-eb0d3eb67f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:08.155887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:08.237040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 700/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:08.275691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b0e4-3bbd-496d-964b-c88bb9015113 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:08.277258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ad55b0e4-3bbd-496d-964b-c88bb9015113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:08.383171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b0e4-3bbd-496d-964b-c88bb9015113 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:08.395895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:08.458718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:08.459320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:08.459596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:08.459867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:08.461522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:08.568794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:08.570219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e426dc9-0068-4732-9b45-1493a5c93025 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:08.588059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 746/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:10.901909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941af2-45f6-4e3c-8dbf-1a79fa18beff None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:10.902431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941af2-45f6-4e3c-8dbf-1a79fa18beff None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:10.902431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941af2-45f6-4e3c-8dbf-1a79fa18beff None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:10.903787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 701/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:10.909798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419425b2-664a-41d3-ae67-254bf991f0ac None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:10.910209 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419425b2-664a-41d3-ae67-254bf991f0ac None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:10.910339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419425b2-664a-41d3-ae67-254bf991f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:10.958620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:10.978072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-419425b2-664a-41d3-ae67-254bf991f0ac None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:10.979265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-419425b2-664a-41d3-ae67-254bf991f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:11.076224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 747/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:11.115773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941af2-45f6-4e3c-8dbf-1a79fa18beff None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:11.117346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef941af2-45f6-4e3c-8dbf-1a79fa18beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:11.220780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941af2-45f6-4e3c-8dbf-1a79fa18beff None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:11.259672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:11.297114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:11.298340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:11.298617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:11.298881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:11.300450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:11.407980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:11.409369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f416d-2f4c-41c7-b925-b6284e393587 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:11.428353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 702/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:13.551861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d5ba-a312-44d4-a229-f1aa67fea8b1 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:13.552423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d5ba-a312-44d4-a229-f1aa67fea8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:13.552423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d5ba-a312-44d4-a229-f1aa67fea8b1 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:13.553745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 748/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:13.558866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b715e7-da06-4b15-a860-4b0e7c2e949b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:13.559285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b715e7-da06-4b15-a860-4b0e7c2e949b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:13.559408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b715e7-da06-4b15-a860-4b0e7c2e949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:13.749922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-75b715e7-da06-4b15-a860-4b0e7c2e949b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:13.752235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-75b715e7-da06-4b15-a860-4b0e7c2e949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:13.772744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:13.849788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 703/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:13.890579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005d5ba-a312-44d4-a229-f1aa67fea8b1 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:13.892763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6005d5ba-a312-44d4-a229-f1aa67fea8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:13.995603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005d5ba-a312-44d4-a229-f1aa67fea8b1 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:14.016571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:14.075971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:14.076597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:14.076867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:14.077136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:14.078792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:14.187030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:14.188386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7598-4189-4cb9-ba6c-be80a369a929 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:14.206069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 749/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:16.327169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedd7c7-e8ba-4c8c-864b-562b07f6c5b2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:16.327637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedd7c7-e8ba-4c8c-864b-562b07f6c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:16.327734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedd7c7-e8ba-4c8c-864b-562b07f6c5b2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:16.329462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 704/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:16.334597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56649-ba6a-4af4-8f76-f896f2dd0632 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:16.335013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56649-ba6a-4af4-8f76-f896f2dd0632 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:16.335139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56649-ba6a-4af4-8f76-f896f2dd0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:16.397594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:16.400177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5ae56649-ba6a-4af4-8f76-f896f2dd0632 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:16.401914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5ae56649-ba6a-4af4-8f76-f896f2dd0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:16.497291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 750/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:16.535803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedd7c7-e8ba-4c8c-864b-562b07f6c5b2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:16.537431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-daedd7c7-e8ba-4c8c-864b-562b07f6c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:16.639594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedd7c7-e8ba-4c8c-864b-562b07f6c5b2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:16.689717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:16.714178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:16.714782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:16.715058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:16.715327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:16.716940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:16.824993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:16.826429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9604179-d71c-47dd-addd-4318a5973cca service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:16.845694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 705/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:18.880131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9665-9f6b-4a11-bfd3-86c6e01ddda8 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:18.880682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9665-9f6b-4a11-bfd3-86c6e01ddda8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:18.880682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9665-9f6b-4a11-bfd3-86c6e01ddda8 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:18.882029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 751/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:18.887461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6606f-fa33-4d9a-a5d4-17bde6a36efb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:18.887893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6606f-fa33-4d9a-a5d4-17bde6a36efb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:18.888113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6606f-fa33-4d9a-a5d4-17bde6a36efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:18.955090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-62e6606f-fa33-4d9a-a5d4-17bde6a36efb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:18.956299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-62e6606f-fa33-4d9a-a5d4-17bde6a36efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:18.984197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:19.052007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 706/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:19.090600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9665-9f6b-4a11-bfd3-86c6e01ddda8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:19.092120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-179e9665-9f6b-4a11-bfd3-86c6e01ddda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:19.194827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9665-9f6b-4a11-bfd3-86c6e01ddda8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:19.222792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:19.272338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:19.272974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:19.273246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:19.273511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:19.275081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:19.385070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:19.386410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2bed-3963-444f-a175-2633177b7297 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:19.404324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 752/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:21.446887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fa43-5646-49a7-bd7c-a42aaa884ff2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:21.447429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fa43-5646-49a7-bd7c-a42aaa884ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:21.447429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fa43-5646-49a7-bd7c-a42aaa884ff2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:21.448815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 707/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:21.454552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30068-7f13-4113-880d-3ea7fe3cb9ce None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:21.454955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30068-7f13-4113-880d-3ea7fe3cb9ce None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:21.455096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30068-7f13-4113-880d-3ea7fe3cb9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:21.521233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c5d30068-7f13-4113-880d-3ea7fe3cb9ce None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:21.522436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c5d30068-7f13-4113-880d-3ea7fe3cb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:21.530817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:21.618493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 753/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:21.657233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fa43-5646-49a7-bd7c-a42aaa884ff2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:21.658741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bef9fa43-5646-49a7-bd7c-a42aaa884ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:21.759623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fa43-5646-49a7-bd7c-a42aaa884ff2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:21.813983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:21.832636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:21.833240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:21.833518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:21.833784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:21.835367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:21.941012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:21.942443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8311c-e5f1-46a1-828e-0cb69382b0d7 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:21.961156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 708/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:23.992599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687031-8f75-49a0-b439-38334c15f2b9 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:23.993170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687031-8f75-49a0-b439-38334c15f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:23.993170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687031-8f75-49a0-b439-38334c15f2b9 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:23.994501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 754/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:23.999730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e989-7eff-4d1c-a95d-ed1b804d5703 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:24.000753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e989-7eff-4d1c-a95d-ed1b804d5703 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:24.000929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e989-7eff-4d1c-a95d-ed1b804d5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:24.066205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c2f4e989-7eff-4d1c-a95d-ed1b804d5703 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:24.067323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c2f4e989-7eff-4d1c-a95d-ed1b804d5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:24.105409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:24.163106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 709/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:24.200219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687031-8f75-49a0-b439-38334c15f2b9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:24.201783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-56687031-8f75-49a0-b439-38334c15f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:24.305877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687031-8f75-49a0-b439-38334c15f2b9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:24.343623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:24.381334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:24.381961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:24.382237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:24.382506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:24.384117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:24.491712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:24.493163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106005a-f4b3-4d13-a0bd-e8c10a488bec service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:24.512484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 755/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:26.555480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944a3d-a0be-46ce-974c-9ba9c513ae8b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:26.556009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944a3d-a0be-46ce-974c-9ba9c513ae8b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:26.556009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944a3d-a0be-46ce-974c-9ba9c513ae8b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:26.557384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 710/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:26.563291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed15e8-7e52-4408-b0c1-e922baeeb2fa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:26.563973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed15e8-7e52-4408-b0c1-e922baeeb2fa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:26.563973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed15e8-7e52-4408-b0c1-e922baeeb2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:26.629711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a3ed15e8-7e52-4408-b0c1-e922baeeb2fa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:26.630907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a3ed15e8-7e52-4408-b0c1-e922baeeb2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:26.648554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:26.725796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 756/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:26.763055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944a3d-a0be-46ce-974c-9ba9c513ae8b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:26.764620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7c944a3d-a0be-46ce-974c-9ba9c513ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:26.866494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944a3d-a0be-46ce-974c-9ba9c513ae8b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:26.931325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:26.938025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:26.938635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:26.938911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:26.939230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:26.940831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:27.048943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:27.050384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70756eb-755a-4c3a-a448-33facd3e3b69 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:27.068179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 711/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:29.069436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e432f1-77fb-4cc1-92ea-b8a48f4a9bc1 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:29.070048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e432f1-77fb-4cc1-92ea-b8a48f4a9bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:29.070048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e432f1-77fb-4cc1-92ea-b8a48f4a9bc1 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:29.071205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 757/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:29.078810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d11582-bc2f-402e-81cf-b720c685e280 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:29.079298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d11582-bc2f-402e-81cf-b720c685e280 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:29.079404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d11582-bc2f-402e-81cf-b720c685e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:29.146587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e7d11582-bc2f-402e-81cf-b720c685e280 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:29.147797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e7d11582-bc2f-402e-81cf-b720c685e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:29.196324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:29.244189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 712/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:29.283230 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e432f1-77fb-4cc1-92ea-b8a48f4a9bc1 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:29.284836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-46e432f1-77fb-4cc1-92ea-b8a48f4a9bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:29.391093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e432f1-77fb-4cc1-92ea-b8a48f4a9bc1 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:29.440747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:29.467571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:29.468174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:29.468996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:29.469757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:29.471349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:29.581689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:29.583109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9251b1-1780-4321-b862-789b776fe1db service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:29.602399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 758/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:39.242440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=22 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:39.600213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=66 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:49.136017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2606c-e542-4618-b5a0-2b163685271e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:49.136554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2606c-e542-4618-b5a0-2b163685271e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:49.136554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2606c-e542-4618-b5a0-2b163685271e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:49.137847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 713/1471] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:49.143036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949bd08-c365-4bad-ad2c-96a54e56ecb8 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:49.143424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949bd08-c365-4bad-ad2c-96a54e56ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:49.143572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949bd08-c365-4bad-ad2c-96a54e56ecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:49.210452 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d949bd08-c365-4bad-ad2c-96a54e56ecb8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:49.211648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d949bd08-c365-4bad-ad2c-96a54e56ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:49.308715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 759/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:49.392375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdf6a5-cf29-4112-96f5-551f4140ade7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:49.392675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdf6a5-cf29-4112-96f5-551f4140ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:49.392946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdf6a5-cf29-4112-96f5-551f4140ade7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:49.394302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 714/1473] 10.222.0.25 () {54 vars in 966 bytes} [Sun Aug 7 18:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:49.399187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c5bc2-6c9c-4f45-aed0-08343d741b2b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:49.399506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c5bc2-6c9c-4f45-aed0-08343d741b2b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:49.399783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c5bc2-6c9c-4f45-aed0-08343d741b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:49.475758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4b4c5bc2-6c9c-4f45-aed0-08343d741b2b None None] MFA Rules not processed for user `d8ab184b2ae0437d9fb01eac225baf06`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:49.477006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4b4c5bc2-6c9c-4f45-aed0-08343d741b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:49.498192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:49.553023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 760/1474] 10.222.0.25 () {58 vars in 1063 bytes} [Sun Aug 7 18:14:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:49.560638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdf6a5-cf29-4112-96f5-551f4140ade7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:49.562175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d5cdf6a5-cf29-4112-96f5-551f4140ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:49.665116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdf6a5-cf29-4112-96f5-551f4140ade7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:49.737179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:49.738099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:49.738374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:49.738645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:49.740224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:49.798486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:49.855784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:49.857256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00448292-1ce9-4f65-a170-7f3e9fa4b656 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:49.875454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 715/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:51.956733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb72b8-08fd-4257-9ca3-a76dcb2520b9 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:51.957326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb72b8-08fd-4257-9ca3-a76dcb2520b9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:51.957326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb72b8-08fd-4257-9ca3-a76dcb2520b9 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:51.958610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 761/1476] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:51.963858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6682dd-36aa-40d4-8748-ff45e121ca16 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:51.964277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6682dd-36aa-40d4-8748-ff45e121ca16 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:51.964405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6682dd-36aa-40d4-8748-ff45e121ca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:52.030897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8f6682dd-36aa-40d4-8748-ff45e121ca16 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:52.032268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f6682dd-36aa-40d4-8748-ff45e121ca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:52.126968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 716/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:52.149688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb72b8-08fd-4257-9ca3-a76dcb2520b9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:52.151230 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3bbb72b8-08fd-4257-9ca3-a76dcb2520b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:52.274778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb72b8-08fd-4257-9ca3-a76dcb2520b9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:52.323559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:52.368603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:52.369210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:52.369482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:52.369746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:52.370378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:52.372097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:14:52.372097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:14:52.372097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:14:52.373254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba203ee-2333-4b74-bcaf-e24e42a66876 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:52.392628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 762/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Aug 7 18:14:52 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:14:54.435200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3a64-341c-4981-8444-2481385bf1fd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:54.435723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3a64-341c-4981-8444-2481385bf1fd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:54.435723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3a64-341c-4981-8444-2481385bf1fd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:54.437134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 717/1479] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:54.442401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9061ca-2dde-4ad8-af18-12f6e42003c3 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:54.442806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9061ca-2dde-4ad8-af18-12f6e42003c3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:54.442947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9061ca-2dde-4ad8-af18-12f6e42003c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:54.508726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9c9061ca-2dde-4ad8-af18-12f6e42003c3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:54.510235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9c9061ca-2dde-4ad8-af18-12f6e42003c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:54.610017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 763/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:54.654445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de3a64-341c-4981-8444-2481385bf1fd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:54.656716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-15de3a64-341c-4981-8444-2481385bf1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:54.666570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:54.803683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de3a64-341c-4981-8444-2481385bf1fd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:54.882918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:54.915313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25748004-da39-476a-aca7-00bab532d20a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:54.915918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25748004-da39-476a-aca7-00bab532d20a service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:54.916186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25748004-da39-476a-aca7-00bab532d20a service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:54.916447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25748004-da39-476a-aca7-00bab532d20a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:54.918051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-25748004-da39-476a-aca7-00bab532d20a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:55.004924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25748004-da39-476a-aca7-00bab532d20a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:55.006493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25748004-da39-476a-aca7-00bab532d20a service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:55.023894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 718/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:57.213787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d54e6-c170-49bf-aa04-56152e87e8c8 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:57.214308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d54e6-c170-49bf-aa04-56152e87e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:57.214308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d54e6-c170-49bf-aa04-56152e87e8c8 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:57.215652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 764/1482] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:57.221423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64585e5a-d4f4-4de7-b0a2-bf2451b00b83 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:57.221843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64585e5a-d4f4-4de7-b0a2-bf2451b00b83 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:57.221992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64585e5a-d4f4-4de7-b0a2-bf2451b00b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:57.286940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64585e5a-d4f4-4de7-b0a2-bf2451b00b83 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:57.288132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64585e5a-d4f4-4de7-b0a2-bf2451b00b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:57.332423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:57.381299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 719/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:57.418143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d54e6-c170-49bf-aa04-56152e87e8c8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:57.419860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e98d54e6-c170-49bf-aa04-56152e87e8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:57.443360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:57.529451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d54e6-c170-49bf-aa04-56152e87e8c8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:57.602217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:57.602812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:57.603086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:57.603350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:57.604960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:57.679165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:57.715094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:57.716521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd8e8b-9a5b-4d94-9b34-115f2ed9a274 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:57.735323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 765/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:59.792119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcdad9-a5e5-4246-947f-b2f64af3d8e6 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:59.792794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcdad9-a5e5-4246-947f-b2f64af3d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:59.792794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcdad9-a5e5-4246-947f-b2f64af3d8e6 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:59.794034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 720/1485] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:59.799597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aae4d-cce4-4be9-adbc-861c487aac8b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:59.800029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aae4d-cce4-4be9-adbc-861c487aac8b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:59.800135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aae4d-cce4-4be9-adbc-861c487aac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:59.866609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ae3aae4d-cce4-4be9-adbc-861c487aac8b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:59.867804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ae3aae4d-cce4-4be9-adbc-861c487aac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:59.964571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 766/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:00.002999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcdad9-a5e5-4246-947f-b2f64af3d8e6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:00.004518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3efcdad9-a5e5-4246-947f-b2f64af3d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:00.105609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcdad9-a5e5-4246-947f-b2f64af3d8e6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:00.175889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:00.177499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:00.178388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:00.178677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:00.179130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:00.181156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:00.289468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:00.290908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdfd4e-d4bd-492e-aaaa-8a69705a0441 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:00.310258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 721/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:02.474098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ccd-5ce8-44d8-9eec-8bf398d8e674 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:02.474659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ccd-5ce8-44d8-9eec-8bf398d8e674 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:02.474659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ccd-5ce8-44d8-9eec-8bf398d8e674 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:02.476009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 767/1488] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:02.481340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb126be9-bba6-4782-90b3-7202d22acfd2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:02.481766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb126be9-bba6-4782-90b3-7202d22acfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:02.481895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb126be9-bba6-4782-90b3-7202d22acfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:02.547614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-eb126be9-bba6-4782-90b3-7202d22acfd2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:02.548849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eb126be9-bba6-4782-90b3-7202d22acfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:02.601071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:02.646193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 722/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:02.687428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994ccd-5ce8-44d8-9eec-8bf398d8e674 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:02.689077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-24994ccd-5ce8-44d8-9eec-8bf398d8e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:02.725519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:02.794643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994ccd-5ce8-44d8-9eec-8bf398d8e674 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:02.867468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:02.867998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:02.868273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:02.868537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:02.870147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:02.950196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:02.979280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:02.980742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3639a0-a647-4930-b5dc-460c7dd6ff90 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:02.999288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 768/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:05.224023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d8fc-ebb8-47fd-ba48-89b0be0127a1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:05.224638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d8fc-ebb8-47fd-ba48-89b0be0127a1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:05.224638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d8fc-ebb8-47fd-ba48-89b0be0127a1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:05.225978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 723/1491] 10.222.0.25 () {54 vars in 927 bytes} [Sun Aug 7 18:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:05.231062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f328e41-fcc6-4e73-986d-cc1d1d4c3f4f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:05.231527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f328e41-fcc6-4e73-986d-cc1d1d4c3f4f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:05.231642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f328e41-fcc6-4e73-986d-cc1d1d4c3f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:05.297401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-7f328e41-fcc6-4e73-986d-cc1d1d4c3f4f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:05.298605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7f328e41-fcc6-4e73-986d-cc1d1d4c3f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:05.393270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 769/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:05.434741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d8fc-ebb8-47fd-ba48-89b0be0127a1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:05.436421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7127d8fc-ebb8-47fd-ba48-89b0be0127a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:05.540519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d8fc-ebb8-47fd-ba48-89b0be0127a1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:05.612939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:05.613537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:05.613814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:05.614077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:05.615656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:05.624816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:05.725961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:05.727429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867c2ca-d6f3-48c2-aa98-5d02420aee7a service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:05.745115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 724/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:15.391473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=82 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:15.742857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=50 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:23.704541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:23.705152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:23.705152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:23.780471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:23.781723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:23.877687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 770/1494] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:23.885840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:23.887175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:23.887175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:23.961594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:23.962791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:24.056300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 725/1495] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:24.061639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:24.062829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:24.074698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88238d-15f7-4e73-a140-7ced5db5454e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:24.135025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:24.169999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:24.170595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:24.170876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:24.171146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:24.171780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:16:24.172079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:24.173123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:24.173123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:16:24.173123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:16:24.174004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:24.186079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 771/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:16:24.194389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:24.204338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e286b5-ccc9-4995-81ce-2fa6c33aac56 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:24.264222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:24.297885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:24.298478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:24.298749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:24.299014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:24.299632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:24.301378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:24.301378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:16:24.301378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:16:24.302555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:24.357060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 726/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:16:24 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:16:24.361378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:24.362924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:24.397052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a9b7-5a33-4920-af79-34e9b7e23a33 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:24.491921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:24.492511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:24.492818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:24.493089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:24.493693 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:24.494699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:24.494699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:16:24.494699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:16:24.496679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:24.540907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 772/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:16:24 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:16:24.545553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:24.547044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:24.608357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62663e2-0548-490f-9481-19549d466c21 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:24.689640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:24.701618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:24.702238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:24.702513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:24.702780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:24.703416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:24.704425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:24.704425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:16:24.704425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:16:24.705352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:24.718028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 727/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:16:24.722012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:24.723534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:24.735447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842596d-a6c2-40ad-b2e2-b58205101d5d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:24.759888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:24.832157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:24.832776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:24.833048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:24.833317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:24.833936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:24.834927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:24.834927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:16:24.834927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:16:24.835790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d80eed-e7df-4ae3-98d0-a0bdbcee1743 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:24.848277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 773/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:16:24.852463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:24.853989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:24.886971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfefd1a-9271-461e-82ef-4c3c9a2107e9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:24.977767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:24.978410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:24.978702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:24.978973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] PATH_INFO: `/v3/projects/6b29e536ab114847ac63c0426464aa21/users/20c91332a7cc44b9bbaae9e8316dd18d/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.000346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b29e536ab114847ac63c0426464aa21, user_id=20c91332a7cc44b9bbaae9e8316dd18d, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:25.001398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:25.001398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:16:25.001398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:16:25.003309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec660b1-373f-4130-a4b3-427e1a5b337c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:25.029301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 728/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:16:24 2022] PUT /identity/v3/projects/6b29e536ab114847ac63c0426464aa21/users/20c91332a7cc44b9bbaae9e8316dd18d/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:16:25.041469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363c1b9-aa0a-4969-9ba0-5044284153bc None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:25.041745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363c1b9-aa0a-4969-9ba0-5044284153bc None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:25.042014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363c1b9-aa0a-4969-9ba0-5044284153bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.099167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8363c1b9-aa0a-4969-9ba0-5044284153bc None None] MFA Rules not processed for user `20c91332a7cc44b9bbaae9e8316dd18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:25.100288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8363c1b9-aa0a-4969-9ba0-5044284153bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:25.177265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 774/1502] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:25.190207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624218c8-f0e1-46b7-9151-de20927e51c1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:25.190496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624218c8-f0e1-46b7-9151-de20927e51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:25.190776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624218c8-f0e1-46b7-9151-de20927e51c1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.192112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 729/1503] 10.222.0.25 () {54 vars in 964 bytes} [Sun Aug 7 18:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:16:25.196979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5717-b457-4160-99a4-846c85a6d821 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:25.197264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5717-b457-4160-99a4-846c85a6d821 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:25.197535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5717-b457-4160-99a4-846c85a6d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.229188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:25.273347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-27ed5717-b457-4160-99a4-846c85a6d821 None None] MFA Rules not processed for user `9ab6c2c2f06040d09952c23e76d2c8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:25.274561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-27ed5717-b457-4160-99a4-846c85a6d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:25.350082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 775/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Sun Aug 7 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:25.357842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624218c8-f0e1-46b7-9151-de20927e51c1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:25.359350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-624218c8-f0e1-46b7-9151-de20927e51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:25.408815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:25.465484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624218c8-f0e1-46b7-9151-de20927e51c1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:25.538324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:25.538925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:25.539208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:25.539477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.541092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:25.638558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:25.639921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:25.643440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:25.658764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 730/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:16:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:16:25.704295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6159-afa8-481b-80ff-7ded12a84edf None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:25.704607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6159-afa8-481b-80ff-7ded12a84edf None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:25.704888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6159-afa8-481b-80ff-7ded12a84edf None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.706138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 776/1506] 10.222.0.25 () {52 vars in 830 bytes} [Sun Aug 7 18:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:16:25.709846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:25.711080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:25.809495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d43b6-3c28-4a4e-a841-c9aaea1257b4 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:25.903363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:25.904021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:25.904178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:25.904453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] PATH_INFO: `/v3/users/20c91332a7cc44b9bbaae9e8316dd18d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:25.916872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c91332a7cc44b9bbaae9e8316dd18d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:25.918461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:25.918461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:16:25.918461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:16:25.919666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:25.929245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:25.987449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c91332a7cc44b9bbaae9e8316dd18d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:25.997053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c91332a7cc44b9bbaae9e8316dd18d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:25.997690 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c91332a7cc44b9bbaae9e8316dd18d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:25.998218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c91332a7cc44b9bbaae9e8316dd18d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:26.012632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c91332a7cc44b9bbaae9e8316dd18d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:26.040508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 731/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:16:25 2022] DELETE /identity/v3/users/20c91332a7cc44b9bbaae9e8316dd18d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:16:26.044976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:26.045463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:26.045579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:26.101508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:26.102708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:26.177823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:26.191994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 777/1508] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:26.202297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:26.203501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:26.299344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7290e4-2aa7-4e0f-a8e5-da6603d0c2d5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:26.355577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:26.376331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:26.376965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:26.377241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:26.377510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:26.379117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:26.487866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:26.489341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a862e3-3286-4bb2-9fdf-82e4f852efa1 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:26.508531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 732/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:16:26.882094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:26.883347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:26.896182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5426b60-1b53-41ae-96fc-2d16b48277a6 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:26.991217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:26.991848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:26.992131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:26.992400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] PATH_INFO: `/v3/projects/6b29e536ab114847ac63c0426464aa21` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:27.002840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b29e536ab114847ac63c0426464aa21)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:27.003864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:27.003864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:16:27.003864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:16:27.005107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:27.062324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b29e536ab114847ac63c0426464aa21', 'request_id': 'req-7b384d5d-fccb-417b-8c97-bb0cb890aded'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:27.069235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b29e536ab114847ac63c0426464aa21', 'request_id': 'req-7b384d5d-fccb-417b-8c97-bb0cb890aded'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:27.079238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b29e536ab114847ac63c0426464aa21', 'request_id': 'req-7b384d5d-fccb-417b-8c97-bb0cb890aded'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:27.108822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] The token cache is being invalidate because project 6b29e536ab114847ac63c0426464aa21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:16:27.109108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:27.109631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b384d5d-fccb-417b-8c97-bb0cb890aded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:27.110946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 778/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:16:26 2022] DELETE /identity/v3/projects/6b29e536ab114847ac63c0426464aa21 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:16:36.505636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=62 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:37.106692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:17:57.412481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a83a4-90b9-4e5d-80a3-015f670288d2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:57.413108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a83a4-90b9-4e5d-80a3-015f670288d2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:57.413108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a83a4-90b9-4e5d-80a3-015f670288d2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:57.414400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 733/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:17:57.419248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fafaa-d1bf-4918-b3cc-ae97caa3c46d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:57.419711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fafaa-d1bf-4918-b3cc-ae97caa3c46d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:57.419820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fafaa-d1bf-4918-b3cc-ae97caa3c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:57.502158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f14fafaa-d1bf-4918-b3cc-ae97caa3c46d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:17:57.503365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f14fafaa-d1bf-4918-b3cc-ae97caa3c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:57.608782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 779/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:17:57.762083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a83a4-90b9-4e5d-80a3-015f670288d2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:17:57.764181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3b5a83a4-90b9-4e5d-80a3-015f670288d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:57.885732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a83a4-90b9-4e5d-80a3-015f670288d2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:17:57.891144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad0ea0-8410-48da-9c5f-0b2a28aa5f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:17:57.891747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad0ea0-8410-48da-9c5f-0b2a28aa5f00 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:57.892023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad0ea0-8410-48da-9c5f-0b2a28aa5f00 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:57.892293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad0ea0-8410-48da-9c5f-0b2a28aa5f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:57.900853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad0ea0-8410-48da-9c5f-0b2a28aa5f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:17:57.902424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad0ea0-8410-48da-9c5f-0b2a28aa5f00 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:17:57.912901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 734/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:17:58.750067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79508f9-ae57-4990-ba9a-54791f67fa0a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:58.750613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79508f9-ae57-4990-ba9a-54791f67fa0a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:58.750613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79508f9-ae57-4990-ba9a-54791f67fa0a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:58.751957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 780/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:17:58.757542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1ded5-c5f5-4ec4-8723-1813a4b63664 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:58.757964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1ded5-c5f5-4ec4-8723-1813a4b63664 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:58.758072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1ded5-c5f5-4ec4-8723-1813a4b63664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:58.777402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7cf1ded5-c5f5-4ec4-8723-1813a4b63664 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:17:58.778600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7cf1ded5-c5f5-4ec4-8723-1813a4b63664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:58.787033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 735/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:17:58.941798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79508f9-ae57-4990-ba9a-54791f67fa0a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:17:58.955922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79508f9-ae57-4990-ba9a-54791f67fa0a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:17:58.961481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07834ec8-f6f6-4d3f-9858-70e5d081b535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:17:58.962070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834ec8-f6f6-4d3f-9858-70e5d081b535 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:58.962342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834ec8-f6f6-4d3f-9858-70e5d081b535 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:58.962608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834ec8-f6f6-4d3f-9858-70e5d081b535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:58.970574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07834ec8-f6f6-4d3f-9858-70e5d081b535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:17:58.972169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07834ec8-f6f6-4d3f-9858-70e5d081b535 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:17:58.981805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 781/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:17:59.525418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312095a5-65fe-4507-bb60-6e86f12b7471 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:59.525727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312095a5-65fe-4507-bb60-6e86f12b7471 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:59.525944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312095a5-65fe-4507-bb60-6e86f12b7471 None None] PATH_INFO: `/v3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:59.527222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 736/1517] 10.222.0.23 () {54 vars in 925 bytes} [Sun Aug 7 18:17:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:17:59.533470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd1ecf-353e-45c4-b2a5-b2b5cb1a1cb0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:59.533771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd1ecf-353e-45c4-b2a5-b2b5cb1a1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:59.534062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd1ecf-353e-45c4-b2a5-b2b5cb1a1cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:59.592484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9ffd1ecf-353e-45c4-b2a5-b2b5cb1a1cb0 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:17:59.593777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9ffd1ecf-353e-45c4-b2a5-b2b5cb1a1cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:59.610395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:17:59.664374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 782/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Aug 7 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:08.640332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adc1d-e2aa-4421-838f-10e4fdc8fdd2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:08.640929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adc1d-e2aa-4421-838f-10e4fdc8fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:08.640929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adc1d-e2aa-4421-838f-10e4fdc8fdd2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:08.642159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 737/1519] 10.222.0.25 () {54 vars in 961 bytes} [Sun Aug 7 18:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:08.647972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407253-71f0-4c03-8793-0b0ad202857d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:08.648412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407253-71f0-4c03-8793-0b0ad202857d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:08.648524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407253-71f0-4c03-8793-0b0ad202857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:08.668144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-cd407253-71f0-4c03-8793-0b0ad202857d None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:08.669393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cd407253-71f0-4c03-8793-0b0ad202857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:08.678002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 783/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Aug 7 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:08.685372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adc1d-e2aa-4421-838f-10e4fdc8fdd2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:08.699131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adc1d-e2aa-4421-838f-10e4fdc8fdd2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:08.704122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baf7ac-16ed-4b54-be3a-f61d1bd0c722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:08.704744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf7ac-16ed-4b54-be3a-f61d1bd0c722 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:08.705023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf7ac-16ed-4b54-be3a-f61d1bd0c722 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:08.705293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf7ac-16ed-4b54-be3a-f61d1bd0c722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:08.714002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baf7ac-16ed-4b54-be3a-f61d1bd0c722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:08.715577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baf7ac-16ed-4b54-be3a-f61d1bd0c722 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:08.725639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 738/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:10.229270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e661ced-6d35-40a8-b36b-0ec09c106201 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:10.229846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e661ced-6d35-40a8-b36b-0ec09c106201 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:10.229846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e661ced-6d35-40a8-b36b-0ec09c106201 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:10.231166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 784/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:10.235813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1df29-58b2-4ffa-9a54-88ec89ef6027 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:10.236215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1df29-58b2-4ffa-9a54-88ec89ef6027 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:10.236357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1df29-58b2-4ffa-9a54-88ec89ef6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:10.257291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-acd1df29-58b2-4ffa-9a54-88ec89ef6027 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:10.258495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-acd1df29-58b2-4ffa-9a54-88ec89ef6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:10.266242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 739/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:10.421476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e661ced-6d35-40a8-b36b-0ec09c106201 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:10.438315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e661ced-6d35-40a8-b36b-0ec09c106201 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:10.445016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c49bb-b40a-4383-a963-7270daee5c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:10.445603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c49bb-b40a-4383-a963-7270daee5c22 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:10.445874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c49bb-b40a-4383-a963-7270daee5c22 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:10.446138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c49bb-b40a-4383-a963-7270daee5c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:10.454330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c49bb-b40a-4383-a963-7270daee5c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:10.455897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c49bb-b40a-4383-a963-7270daee5c22 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:10.465111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 785/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:11.281882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd79b9-49cd-490c-a653-06d3bd80ceb5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:11.282421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd79b9-49cd-490c-a653-06d3bd80ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:11.282421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd79b9-49cd-490c-a653-06d3bd80ceb5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:11.283767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 740/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:11.288527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663817ad-c4c4-44bd-a750-59b17e751026 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:11.288987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663817ad-c4c4-44bd-a750-59b17e751026 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:11.289095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663817ad-c4c4-44bd-a750-59b17e751026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:11.308494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-663817ad-c4c4-44bd-a750-59b17e751026 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:11.309737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-663817ad-c4c4-44bd-a750-59b17e751026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:11.318199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 786/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:11.469404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd79b9-49cd-490c-a653-06d3bd80ceb5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:11.483823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd79b9-49cd-490c-a653-06d3bd80ceb5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:11.490024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6bb65-43d7-4945-8cca-d7a13bc19f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:11.490636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6bb65-43d7-4945-8cca-d7a13bc19f59 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:11.490907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6bb65-43d7-4945-8cca-d7a13bc19f59 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:11.491173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6bb65-43d7-4945-8cca-d7a13bc19f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:11.499671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6bb65-43d7-4945-8cca-d7a13bc19f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:11.501288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6bb65-43d7-4945-8cca-d7a13bc19f59 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:11.511639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 741/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:15.266201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7461f-b3c5-488a-b5a1-ffc268886fc4 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:15.266775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7461f-b3c5-488a-b5a1-ffc268886fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:15.266775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7461f-b3c5-488a-b5a1-ffc268886fc4 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:15.268104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 787/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:15.273189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073f3d5-fe6f-4a30-ba35-1236454ad1f7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:15.273592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073f3d5-fe6f-4a30-ba35-1236454ad1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:15.273707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073f3d5-fe6f-4a30-ba35-1236454ad1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:15.293204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7073f3d5-fe6f-4a30-ba35-1236454ad1f7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:15.294395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7073f3d5-fe6f-4a30-ba35-1236454ad1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:15.302689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 742/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:15.375920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7461f-b3c5-488a-b5a1-ffc268886fc4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:15.377622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-11d7461f-b3c5-488a-b5a1-ffc268886fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:15.455457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7461f-b3c5-488a-b5a1-ffc268886fc4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:15.459416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c0a05-e587-42c6-8ffb-ac872d13a644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:15.460001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0a05-e587-42c6-8ffb-ac872d13a644 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:15.460274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0a05-e587-42c6-8ffb-ac872d13a644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:15.460541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0a05-e587-42c6-8ffb-ac872d13a644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:15.469368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c0a05-e587-42c6-8ffb-ac872d13a644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:15.470775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c0a05-e587-42c6-8ffb-ac872d13a644 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:15.480509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 788/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:18:17.498097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0a5a-3d62-425c-97b0-2273c0f70662 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:17.498659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0a5a-3d62-425c-97b0-2273c0f70662 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:17.498659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0a5a-3d62-425c-97b0-2273c0f70662 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:17.499982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 743/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:17.505650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05b82-4973-463c-a4cb-850b3343d7bd None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:17.506077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05b82-4973-463c-a4cb-850b3343d7bd None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:17.506177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05b82-4973-463c-a4cb-850b3343d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:17.525233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c8f05b82-4973-463c-a4cb-850b3343d7bd None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:17.526428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c8f05b82-4973-463c-a4cb-850b3343d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:17.534419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 789/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:17.570367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a0a5a-3d62-425c-97b0-2273c0f70662 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:17.581023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a0a5a-3d62-425c-97b0-2273c0f70662 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:17.584491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed23f-5ba4-48b7-b778-52b367a73e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:17.585099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed23f-5ba4-48b7-b778-52b367a73e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:17.585372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed23f-5ba4-48b7-b778-52b367a73e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:17.585640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed23f-5ba4-48b7-b778-52b367a73e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:17.594455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed23f-5ba4-48b7-b778-52b367a73e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:17.595878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed23f-5ba4-48b7-b778-52b367a73e68 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:17.606294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 744/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:21.055603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4b42-431e-46ca-98fd-8ae03b0410e7 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:21.056118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4b42-431e-46ca-98fd-8ae03b0410e7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:21.056118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4b42-431e-46ca-98fd-8ae03b0410e7 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:21.057438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 790/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:21.062655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99aa0b-8991-4419-94eb-0ae0a9097572 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:21.063088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99aa0b-8991-4419-94eb-0ae0a9097572 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:21.063183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99aa0b-8991-4419-94eb-0ae0a9097572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:21.083309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fe99aa0b-8991-4419-94eb-0ae0a9097572 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:21.084496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe99aa0b-8991-4419-94eb-0ae0a9097572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:21.092149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 745/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:21.397392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a4b42-431e-46ca-98fd-8ae03b0410e7 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:21.399047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f78a4b42-431e-46ca-98fd-8ae03b0410e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:21.465068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:18:21.478427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a4b42-431e-46ca-98fd-8ae03b0410e7 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:21.482051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd629b9-b124-43df-8744-fe541c250864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:21.482646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd629b9-b124-43df-8744-fe541c250864 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:21.482920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd629b9-b124-43df-8744-fe541c250864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:21.483188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd629b9-b124-43df-8744-fe541c250864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:21.491998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd629b9-b124-43df-8744-fe541c250864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:21.493513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd629b9-b124-43df-8744-fe541c250864 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:21.502688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 791/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:23.535476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ec1b1-5898-4e68-b2aa-72095473d154 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:23.536618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ec1b1-5898-4e68-b2aa-72095473d154 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:23.536618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ec1b1-5898-4e68-b2aa-72095473d154 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:23.537909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 746/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:18:23.542959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c466-965e-4ddf-8ec1-67f64e6312a9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:23.543386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c466-965e-4ddf-8ec1-67f64e6312a9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:23.543507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c466-965e-4ddf-8ec1-67f64e6312a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:23.563008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3b23c466-965e-4ddf-8ec1-67f64e6312a9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:23.564194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3b23c466-965e-4ddf-8ec1-67f64e6312a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:23.571970 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 792/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:23.875422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ec1b1-5898-4e68-b2aa-72095473d154 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:23.877134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-174ec1b1-5898-4e68-b2aa-72095473d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:23.890890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ec1b1-5898-4e68-b2aa-72095473d154 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:23.895087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f374-7e33-4b8a-b29c-f3b712062b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:23.896279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f374-7e33-4b8a-b29c-f3b712062b98 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:23.896647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f374-7e33-4b8a-b29c-f3b712062b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:23.896966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f374-7e33-4b8a-b29c-f3b712062b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:23.906001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f374-7e33-4b8a-b29c-f3b712062b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:23.907418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f374-7e33-4b8a-b29c-f3b712062b98 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:23.917139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 747/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:33.558341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=11 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:18:33.913093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:56.810377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:56.811001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:56.811001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:56.836884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:56.838115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:56.852726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 793/1540] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:56.861806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:56.862876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:56.863522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:56.890183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:56.892279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:56.911913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 748/1541] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:56.917320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:56.937263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1e574-c6d8-48fc-88fd-45e4501cf4d3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:56.947247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:56.948314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:56.948859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:56.949365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:56.950268 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:56.950800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:56.957248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:56.971892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 794/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:56.980315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:56.990490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d236-bf20-4878-848d-52aae724f9a8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:56.999016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:56.999631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:56.999906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.000175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.000904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.004183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.051440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 749/1543] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:56 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:57.055470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.070962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617bc83-36ef-4fc0-a918-3435dee79cd5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.152112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.153186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.153710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.154212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.155104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.157627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.197956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 795/1544] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:57.202011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.220120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b54f-ee7e-474b-9b95-1abf36b7fbf0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.230285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.231235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.231805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.232243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.233114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.234965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.248292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 750/1545] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:57.252579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.266545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfda7-7b94-40b3-8197-7c85b219dc1d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.275896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73207d51-9532-4e78-a40b-3d236ddabc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.276740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207d51-9532-4e78-a40b-3d236ddabc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.277021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207d51-9532-4e78-a40b-3d236ddabc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.277295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207d51-9532-4e78-a40b-3d236ddabc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.277972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207d51-9532-4e78-a40b-3d236ddabc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.279706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207d51-9532-4e78-a40b-3d236ddabc00 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.296351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 796/1546] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:57.300402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.313641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0347-b4ee-47ae-a57a-00c58d12f398 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.325518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbe9ed-5f5e-4019-b0c2-8a02d3737ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.326560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe9ed-5f5e-4019-b0c2-8a02d3737ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.327071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe9ed-5f5e-4019-b0c2-8a02d3737ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.327569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe9ed-5f5e-4019-b0c2-8a02d3737ecb admin admin] PATH_INFO: `/v3/projects/e8166c97642549a7ad92de4f901078c0/users/f617c22150914a45887bd29cf2d5feac/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.343834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a548-78f3-49b4-996f-821fa9c71f49 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.343834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a548-78f3-49b4-996f-821fa9c71f49 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.343834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a548-78f3-49b4-996f-821fa9c71f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.351677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbe9ed-5f5e-4019-b0c2-8a02d3737ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8166c97642549a7ad92de4f901078c0, user_id=f617c22150914a45887bd29cf2d5feac, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.354959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbe9ed-5f5e-4019-b0c2-8a02d3737ecb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.377040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 751/1547] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:57 2022] PUT /identity/v3/projects/e8166c97642549a7ad92de4f901078c0/users/f617c22150914a45887bd29cf2d5feac/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:57.379800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4c26a548-78f3-49b4-996f-821fa9c71f49 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.381476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4c26a548-78f3-49b4-996f-821fa9c71f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.383106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.383739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.384243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.412591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.414420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.503770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 752/1548] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:19:57.514927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 797/1549] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:19:57.516245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.524219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cdf6-9bf0-4653-ad86-ae581b719ee2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.524504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cdf6-9bf0-4653-ad86-ae581b719ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.525028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cdf6-9bf0-4653-ad86-ae581b719ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.560907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-52d8cdf6-9bf0-4653-ad86-ae581b719ee2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.562124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-52d8cdf6-9bf0-4653-ad86-ae581b719ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.583207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 798/1550] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.584591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.584937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.585149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.604696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de7cd-93e2-4003-a83e-bd288c67138f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.613244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.613425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063d79-f379-4084-a77a-ac53b17a8bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.613870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063d79-f379-4084-a77a-ac53b17a8bed service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.614151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063d79-f379-4084-a77a-ac53b17a8bed service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.614423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063d79-f379-4084-a77a-ac53b17a8bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.614619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.623185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 799/1551] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.624112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.633374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81063d79-f379-4084-a77a-ac53b17a8bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.633882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be275d-2b18-4e64-9441-f936d25519f9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.634839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81063d79-f379-4084-a77a-ac53b17a8bed service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.639130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.639751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.640029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.640301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.641106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:57.641416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.643023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e086df-fd0b-40fe-b097-3adb67a78c64 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.654241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 753/1552] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:57.657063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092e58-4f27-4359-a740-06baf170d879 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.657352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092e58-4f27-4359-a740-06baf170d879 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.657629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092e58-4f27-4359-a740-06baf170d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.658464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 800/1553] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:57.660006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.660415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.664755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.697462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.698778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.712590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3d092e58-4f27-4359-a740-06baf170d879 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.712590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3d092e58-4f27-4359-a740-06baf170d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.712888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 801/1554] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.712888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.723159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f6063-0bb4-4413-bd49-b574c67203a0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.725819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 754/1555] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.727729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b79c6-a573-4ef7-9cb6-683e3b7d049c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.728014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b79c6-a573-4ef7-9cb6-683e3b7d049c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.728130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.728321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b79c6-a573-4ef7-9cb6-683e3b7d049c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.728957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.729240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.729514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.730148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.731229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:57.731229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:19:57.731229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:19:57.733002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.749810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7a7b79c6-a573-4ef7-9cb6-683e3b7d049c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.751079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a7b79c6-a573-4ef7-9cb6-683e3b7d049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.762656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 755/1556] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.764106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00435-497a-42b6-8e8c-ac37e5286717 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.764395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00435-497a-42b6-8e8c-ac37e5286717 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.764701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00435-497a-42b6-8e8c-ac37e5286717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.772996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 802/1557] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:57.774385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.782505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:57.790542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-63b00435-497a-42b6-8e8c-ac37e5286717 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.792162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-63b00435-497a-42b6-8e8c-ac37e5286717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.813429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:57.853242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73d6b-f0f5-4d03-a1ac-aa07cd111c3d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.858580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.859270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.859616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.859965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.860647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:57.860954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.863123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e70044-28e5-474b-9577-dd2153dec0de admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.874333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 756/1558] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.875895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 803/1559] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:57.877135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e1566-4e2a-4b08-bd54-d4489267f772 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.877418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e1566-4e2a-4b08-bd54-d4489267f772 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.877589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45f9e-0ab8-41f0-bf69-bfcc4ca57743 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.877841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e1566-4e2a-4b08-bd54-d4489267f772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.878326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45f9e-0ab8-41f0-bf69-bfcc4ca57743 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.878911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45f9e-0ab8-41f0-bf69-bfcc4ca57743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.907002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-09d45f9e-0ab8-41f0-bf69-bfcc4ca57743 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.908289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-09d45f9e-0ab8-41f0-bf69-bfcc4ca57743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.909238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-754e1566-4e2a-4b08-bd54-d4489267f772 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.910653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-754e1566-4e2a-4b08-bd54-d4489267f772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.916872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 757/1560] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.918480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.918480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.918948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.930648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 804/1561] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.930648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.930648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.930648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.939564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.940983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.949747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 758/1562] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.950322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.961202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:57.962027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17723e-294d-43e6-a20c-a76cd91e6565 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:57.962557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:57.967946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:57.968282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:57.968429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:57.968725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:57.969350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:57.970379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:57.970379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:19:57.970379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:19:57.971682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdbc6b-a045-4d22-8f80-b7f8f0d73a50 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:57.976982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 805/1563] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:57.976982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:57.986434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bacd-f44e-4009-b7da-4902cdbe089a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.001433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.002661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.004049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.004772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.005844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.006335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 759/1564] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/users => generated 297 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.008148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92618-a535-430b-b7d2-be0bb19b331d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.008441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92618-a535-430b-b7d2-be0bb19b331d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.008795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92618-a535-430b-b7d2-be0bb19b331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.009477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.030446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b2e92618-a535-430b-b7d2-be0bb19b331d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:58.031933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b2e92618-a535-430b-b7d2-be0bb19b331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:58.049392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 760/1565] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:58.049392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4298-176c-44ec-a33b-c0a854cd06f1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.049392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4298-176c-44ec-a33b-c0a854cd06f1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.049392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4298-176c-44ec-a33b-c0a854cd06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.058740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 806/1566] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:57 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.059672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.074188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-73ec4298-176c-44ec-a33b-c0a854cd06f1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:58.075589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-73ec4298-176c-44ec-a33b-c0a854cd06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:58.157473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906e45-33d5-4483-b7b7-03dbb379e636 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.157805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 761/1567] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:58.159039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.159323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.160116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.163133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.164918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.165214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.165492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.166368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:58.166506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.168925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.182562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:58.183930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:58.184136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 807/1568] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:58.185015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.194190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 762/1569] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:58.195090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.201743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84510e-91f3-453d-8b2f-5bf992efa65e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.205107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f664-b0a2-4db2-81f1-34aaca32a582 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.207514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.208177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.208456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.208776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.209547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:58.209852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.210643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.211384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.211489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.211745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.212100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.212850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.214522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.225656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 763/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:58.226494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.239124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 808/1571] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:58.239124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.239402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d72ad-40f3-4d10-9a1a-d77ade18ab7a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.242249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.242884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.243164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.243438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.244079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:58.244379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.245341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f819-c7d4-46e4-af3f-875a531dbd4d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.245458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:58.245458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:19:58.245458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:19:58.246411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.250350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.250957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.251220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.251542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.252151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.254650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.265315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 764/1572] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:58.265315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.279123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c561-32a4-4888-adfb-e5490ed8d6fb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.286917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 809/1573] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.286917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.288017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.288737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.289032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.289285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.289993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:58.290287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.292702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.301929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fddc63-0c13-431b-9e66-9970be79616c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.313134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 765/1574] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:58.313134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.313528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.313528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.316722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.317611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.318670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.321690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.324691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d174fa-f02b-4739-b25d-fadc4cac9b3a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.331574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.331574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.331574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.331574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.331953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:58.331953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.333477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.348900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 766/1575] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:58.349967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.359465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 810/1576] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.359465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.365587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:58.368182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429656-504d-42ef-ba78-62b28b1bc88b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.389781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:58.442947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.444314 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.444685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.445063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.446402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.449173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.454654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aff8f9-058b-4e1c-9cab-9f843972679a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.465630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 767/1577] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:58.465824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.466044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.466142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.466142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.466142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.466142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.467606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.489953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce2c4-d1d0-41c8-a321-a55650b256d6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.497450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.498416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.499072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.499925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.500591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.504996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.513835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 811/1578] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.515133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.545356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 768/1579] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.546365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.607172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950df35-461d-4cda-910e-052fff0d79c9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.652271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1169b-732b-4233-838c-6beca3723bb8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.658057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.658801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.659203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.659728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.660654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.663375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.699387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.700177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.700462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.700761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.701631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 769/1580] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.702632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.705260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.707624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.720534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 812/1581] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:58.725978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.738857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0021c9-3faf-4ffd-ac7c-10961432eb3c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.779406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:58.810263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4bbb-47a3-405b-a0d2-3e795ae0be6c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.816982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.817634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.817888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.818165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.818800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.820756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.837399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.838709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.840089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.840632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.841494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.844336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:58.867489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 770/1582] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.868837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.883128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 813/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:58.883128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:58.884743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:58.899874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133495b0-63a8-4f5f-95a7-9f616c9318ac admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.965614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c137dd-d843-4fcc-80e9-e1a2a726fa21 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:58.970545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:58.971285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.971639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.972721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] PATH_INFO: `/v3/projects/fcb3c6d07d0a4b028b6508d791729277/users/17943c8309fc4e97b180373b320595f1/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.993020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb3c6d07d0a4b028b6508d791729277, user_id=17943c8309fc4e97b180373b320595f1, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:58.996772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.010853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.012079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.012547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.013115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.013981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.016550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 771/1584] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:58 2022] PUT /identity/v3/projects/fcb3c6d07d0a4b028b6508d791729277/users/17943c8309fc4e97b180373b320595f1/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:59.017182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.021652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.048735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 814/1585] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:59.049716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.061763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9a55-939b-4723-af5a-fdfa05ce4558 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.117335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339f551-02fa-4bf5-adce-6eef26fd7d89 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.138742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.139395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.139674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.139946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.140638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.142593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.158920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.159705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.160043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.160381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.161133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.163230 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.169184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 772/1586] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:59 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:59.173036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.186783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a417-a97a-4d57-b204-5271a6cb3c29 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.193745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.195987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 815/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:59 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:59.196686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.199604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.199919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.200305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.201116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.202763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.208673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21dd2-50b6-4046-87fe-0a635f32cfcb admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.217460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 773/1588] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.218604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.219376 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a21ce-4fe0-4e2c-b2d6-691092f32b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.220018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a21ce-4fe0-4e2c-b2d6-691092f32b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.220330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a21ce-4fe0-4e2c-b2d6-691092f32b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.220522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a21ce-4fe0-4e2c-b2d6-691092f32b99 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.221169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a21ce-4fe0-4e2c-b2d6-691092f32b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.224027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a21ce-4fe0-4e2c-b2d6-691092f32b99 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.235512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5814ca-924d-4bcc-81e7-14d7f0f45276 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.242222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.243102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.243535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.243977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.244943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.246917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.252842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 816/1589] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:59 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:59.252842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.252842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.252842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.261828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 774/1590] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.262830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.273736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:59.275101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:59.275285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf70a8-0174-4802-a497-4728699838c5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.282688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.283182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.283443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.283781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.284417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.286533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.291928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 817/1591] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:59.291928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.302244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c4d0-dbd9-47e4-af84-32a88aedaad4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.307922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.308816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.308981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 775/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.309768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.311853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.312160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.312871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.314540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.323541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e5a85-6309-428f-874c-86f23103e0b8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.327154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 818/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.328100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.329107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.330165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.330478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.330728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.331408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.333053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.339507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff4838-113f-4569-8c9b-01e168b8d17c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.344956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.347318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.347318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.347318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] PATH_INFO: `/v3/projects/3abdce763e8d419785dba0b74b63b5d2/users/a38be80ef1854cb3aeaa5ca40ed043f8/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.351034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:59.453739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 776/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.453739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.453739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811554-2721-4ff7-8ab7-f5a3d9700f93 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.453739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.454525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.454525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.454525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.454525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.454525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.455062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abdce763e8d419785dba0b74b63b5d2, user_id=a38be80ef1854cb3aeaa5ca40ed043f8, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.455062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:59.455062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:19:59.455062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:19:59.455062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.457217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 777/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.457217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.457217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9b48-fcae-430c-8da5-a41dad4d4f57 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.457450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 819/1596] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:59 2022] PUT /identity/v3/projects/3abdce763e8d419785dba0b74b63b5d2/users/a38be80ef1854cb3aeaa5ca40ed043f8/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:59.457450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.457450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:59.467842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:59.508712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908186-9820-4982-b5e9-4dbb19c02fad admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.513066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.513930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.514382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.514667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.515606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.516429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.516954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.517392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.518192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.520250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.528244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.529752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.532605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 778/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.533817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.544460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 820/1598] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:59.545657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.546792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332f403-f105-420a-b3b3-b7b9e256da9d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.557587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.558224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.558507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.558784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.559437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.559558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498503ce-9a81-4ad1-bbf9-96747ebcfc8a service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.561371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.564679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.565559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.566571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.566998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.567792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.569606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.575925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 779/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.577719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.581086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 821/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.582082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.593560 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642de3c-9620-4296-8e54-f27669b73be1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.594218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8a04-5be5-4cfd-9a28-68feb3517d00 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.599542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b010-9b75-4865-a5ae-62112c84c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.600474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b010-9b75-4865-a5ae-62112c84c901 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.600688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b010-9b75-4865-a5ae-62112c84c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.600838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.600963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b010-9b75-4865-a5ae-62112c84c901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.601598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b010-9b75-4865-a5ae-62112c84c901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.601786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.602062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.602432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.603039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.603707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b010-9b75-4865-a5ae-62112c84c901 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.605319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.616843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 822/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.618043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.618276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 780/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:59.618402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.618599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.619018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.637769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44ab15-b80a-4765-bed2-f43ce62c0ea7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.645232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:59.645907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.646591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:59.646818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.647201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.647627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] PATH_INFO: `/v3/projects/4a0184e01f664353bc5ae12f75107b07/users/c39be2efcf0e45eb88e5a1b478feac27/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.658185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 823/1603] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:59.663658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.675313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0184e01f664353bc5ae12f75107b07, user_id=c39be2efcf0e45eb88e5a1b478feac27, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.676421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd440-59ec-4cf1-b22f-66e234802b1c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.680657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.682556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.683416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.683700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.684133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] PATH_INFO: `/v3/projects/ee9b6e97a1204094ab8ef87a9a4ba887/users/d9fc4ef72acb449884e4a722097a4f96/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.701478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 781/1604] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:59 2022] PUT /identity/v3/projects/4a0184e01f664353bc5ae12f75107b07/users/c39be2efcf0e45eb88e5a1b478feac27/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:59.702091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.719548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9b6e97a1204094ab8ef87a9a4ba887, user_id=d9fc4ef72acb449884e4a722097a4f96, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.723179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.745917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 824/1605] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:59 2022] PUT /identity/v3/projects/ee9b6e97a1204094ab8ef87a9a4ba887/users/d9fc4ef72acb449884e4a722097a4f96/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:59.747446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.835932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7437ab-71e6-4ac3-b8b8-2c650c369dc5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.840681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397ac8-bf0f-4974-a7b8-3f091bd604ed admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.840838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.841385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.841767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.842042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] PATH_INFO: `/v3/projects/e995096b6dfd452287ca29000479b873/users/59d29247f612436393d093e5eb26ecfd/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.850459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.852181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.852725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.853110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] PATH_INFO: `/v3/projects/a19928ef49704b53a05bff96b4c1b505/users/20281cc82b0a42fcaa139e837527f61b/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.859524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e995096b6dfd452287ca29000479b873, user_id=59d29247f612436393d093e5eb26ecfd, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.862239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.882429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19928ef49704b53a05bff96b4c1b505, user_id=20281cc82b0a42fcaa139e837527f61b, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.886935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.895777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 825/1606] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:59 2022] PUT /identity/v3/projects/e995096b6dfd452287ca29000479b873/users/59d29247f612436393d093e5eb26ecfd/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:59.897159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.919288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 782/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:59 2022] PUT /identity/v3/projects/a19928ef49704b53a05bff96b4c1b505/users/20281cc82b0a42fcaa139e837527f61b/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:59.920452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.921153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:00.027106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec93e3-5fe7-4496-aa5c-ce18776ac9df admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:00.037173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174661a-68e5-4e27-9f3a-f4ce88e8f7b7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:00.042876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa6c14-bf8b-4110-86f8-5c8a606f5704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:00.043711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa6c14-bf8b-4110-86f8-5c8a606f5704 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.044063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa6c14-bf8b-4110-86f8-5c8a606f5704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.044788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa6c14-bf8b-4110-86f8-5c8a606f5704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.064463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:00.136039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f04d9-bde7-42f0-88e8-fa5b43818ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:00.138123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f04d9-bde7-42f0-88e8-fa5b43818ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.138376 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f04d9-bde7-42f0-88e8-fa5b43818ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.139711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f04d9-bde7-42f0-88e8-fa5b43818ddc admin admin] PATH_INFO: `/v3/projects/c5b6e918eede4a8ead6fbb53a7c29a0d/users/21b60f931d1948eb953e14ccee92da2a/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.146463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa6c14-bf8b-4110-86f8-5c8a606f5704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:00.148192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa6c14-bf8b-4110-86f8-5c8a606f5704 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:00.162348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 783/1608] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:00.163924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f999a-491e-4e27-bbb0-b1146b82ee45 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.164284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f999a-491e-4e27-bbb0-b1146b82ee45 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.164898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f999a-491e-4e27-bbb0-b1146b82ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.182090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f04d9-bde7-42f0-88e8-fa5b43818ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b6e918eede4a8ead6fbb53a7c29a0d, user_id=21b60f931d1948eb953e14ccee92da2a, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:00.185739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f04d9-bde7-42f0-88e8-fa5b43818ddc admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:00.203698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0c7f999a-491e-4e27-bbb0-b1146b82ee45 None None] MFA Rules not processed for user `c39be2efcf0e45eb88e5a1b478feac27`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:00.205579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c7f999a-491e-4e27-bbb0-b1146b82ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:00.217737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 826/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:59 2022] PUT /identity/v3/projects/c5b6e918eede4a8ead6fbb53a7c29a0d/users/21b60f931d1948eb953e14ccee92da2a/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:00.223798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe90ff-01ee-4f01-b4c0-e84c78813ced None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.224266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe90ff-01ee-4f01-b4c0-e84c78813ced None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.225377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe90ff-01ee-4f01-b4c0-e84c78813ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.267854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f2fe90ff-01ee-4f01-b4c0-e84c78813ced None None] MFA Rules not processed for user `d9fc4ef72acb449884e4a722097a4f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:00.271072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f2fe90ff-01ee-4f01-b4c0-e84c78813ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:00.360136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 784/1610] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:00.361900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.362355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.364123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.415296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 827/1611] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:00.415296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b83e-abc0-4d35-9f76-c25c65baac80 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.415296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b83e-abc0-4d35-9f76-c25c65baac80 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.415296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b83e-abc0-4d35-9f76-c25c65baac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.423230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] MFA Rules not processed for user `59d29247f612436393d093e5eb26ecfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:00.425139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:00.468829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-7744b83e-abc0-4d35-9f76-c25c65baac80 None None] MFA Rules not processed for user `20281cc82b0a42fcaa139e837527f61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:00.470161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7744b83e-abc0-4d35-9f76-c25c65baac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:00.504146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:00.607008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 828/1612] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:00.608319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bf613-8293-4e34-af8d-dd0b0be56e8a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.610510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bf613-8293-4e34-af8d-dd0b0be56e8a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.610795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bf613-8293-4e34-af8d-dd0b0be56e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.653824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2c1bf613-8293-4e34-af8d-dd0b0be56e8a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:00.655216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2c1bf613-8293-4e34-af8d-dd0b0be56e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:00.660866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 785/1613] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:00.673333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:00.718984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:00.765958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b68d8-9eac-4416-a192-06e570b31cae None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:00.772286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa887d-955d-4024-9894-627da1890d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:00.773398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa887d-955d-4024-9894-627da1890d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.773684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa887d-955d-4024-9894-627da1890d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.774249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa887d-955d-4024-9894-627da1890d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.774992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa887d-955d-4024-9894-627da1890d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:00.777321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa887d-955d-4024-9894-627da1890d48 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:00.802400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 829/1614] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:00.803725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a188f5-80cb-4c21-b804-441dc3a1b175 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.804053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a188f5-80cb-4c21-b804-441dc3a1b175 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.804379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a188f5-80cb-4c21-b804-441dc3a1b175 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.806042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 830/1615] 10.222.0.25 () {54 vars in 962 bytes} [Sun Aug 7 18:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:00.807147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfed71-9b8b-40a7-ac3a-0802a0f1f72a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.807599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfed71-9b8b-40a7-ac3a-0802a0f1f72a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.807876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfed71-9b8b-40a7-ac3a-0802a0f1f72a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.812373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 831/1616] 10.222.0.25 () {54 vars in 962 bytes} [Sun Aug 7 18:20:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:00.813170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfed71-9b8b-40a7-ac3a-0802a0f1f72a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:00.830025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfed71-9b8b-40a7-ac3a-0802a0f1f72a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:00.838242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425bf98-cc51-4736-b1be-285d44880fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:00.839108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425bf98-cc51-4736-b1be-285d44880fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.839389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425bf98-cc51-4736-b1be-285d44880fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.839660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425bf98-cc51-4736-b1be-285d44880fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.840291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425bf98-cc51-4736-b1be-285d44880fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:00.844027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425bf98-cc51-4736-b1be-285d44880fc9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:00.880252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 786/1617] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:00.881737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e56a2-911e-466d-909b-237ef693249b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.882025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e56a2-911e-466d-909b-237ef693249b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.882299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e56a2-911e-466d-909b-237ef693249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.908490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 832/1618] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:00.910649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.911996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.912280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.005601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b16e56a2-911e-466d-909b-237ef693249b None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:01.007094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b16e56a2-911e-466d-909b-237ef693249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:01.022434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:01.023042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:01.172725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 787/1619] 10.222.0.25 () {58 vars in 1059 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:01.174384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e56a2-911e-466d-909b-237ef693249b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.223584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 833/1620] 10.222.0.25 () {58 vars in 1059 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:01.226540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.283866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:01.337549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e56a2-911e-466d-909b-237ef693249b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.348604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.350644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.351751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.353172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.380851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.381621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b5554-28b0-4566-8438-af672ed791b2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.383166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.393344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.394698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.395308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.396508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.397850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.401461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.410894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 788/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:01.418892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.451789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb884fb-5354-4efb-948e-9a71ac63bb9f service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.474139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 834/1622] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:01 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:01.474606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.476740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.477830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.480305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.481247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.482537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.489723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.523000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb6b3d-584e-4bd7-8671-8a9b6c9e26c5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.544639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.545555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.546096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.546466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.568924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 789/1623] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:01 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:01.570047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.617516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8b1b-ea74-4b85-95df-9d1411816e5d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.637839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.640473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.640903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.641433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.677136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:01.729849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.732678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.759185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 835/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:01.760527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.786606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff631-514a-448f-aaab-33d97b41d407 service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.787650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.792495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.810964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.812196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.813426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.814917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.817222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.822360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.824438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 790/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:01.825402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.841666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 836/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:01.845612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf726f-b730-48c8-81b8-2cbcd2312a25 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.846947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.860025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.860893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.862434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.862828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.863683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.867996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.869315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48bf03-3ef8-4ac4-b7bf-56bda3cd455e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.883379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.884870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.884870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.884870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] PATH_INFO: `/v3/projects/0cbb2233dbc5402ca1e32959a0958fd9/users/8a9b63da9ed6412c939a901cf1f0d3c8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.897937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 791/1627] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:01.898634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.920092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be900-23a1-4832-8dc9-53dbfe5c25ac admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.924507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbb2233dbc5402ca1e32959a0958fd9, user_id=8a9b63da9ed6412c939a901cf1f0d3c8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.930562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.936169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.937069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.938509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.938891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] PATH_INFO: `/v3/projects/99a49e46e4724308901f8c70406c0e65/users/09caeb2fc12a47e08ed2793bb2be7f0a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.959352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 837/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:01 2022] PUT /identity/v3/projects/0cbb2233dbc5402ca1e32959a0958fd9/users/8a9b63da9ed6412c939a901cf1f0d3c8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:01.963123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.979566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a49e46e4724308901f8c70406c0e65, user_id=09caeb2fc12a47e08ed2793bb2be7f0a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.987160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:02.014562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 792/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:01 2022] PUT /identity/v3/projects/99a49e46e4724308901f8c70406c0e65/users/09caeb2fc12a47e08ed2793bb2be7f0a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:02.019134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:02.168993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d62ff-45c8-4c48-99fa-811acc64a5e9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:02.243286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:02.248059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e24592-9f3a-41fb-aa14-58bb66d55686 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:02.270536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:02.273610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.274411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.276280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.278560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:02.287198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:02.327787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 793/1630] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:02.333160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:02.350804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97471-dff5-4930-ab9a-90d8c4f4b551 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:02.358932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316130-3cfe-49bf-b948-56988c05f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:02.360150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316130-3cfe-49bf-b948-56988c05f0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.360650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316130-3cfe-49bf-b948-56988c05f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.361065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316130-3cfe-49bf-b948-56988c05f0d9 admin admin] PATH_INFO: `/v3/projects/99a49e46e4724308901f8c70406c0e65/users/09caeb2fc12a47e08ed2793bb2be7f0a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.364771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316130-3cfe-49bf-b948-56988c05f0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a49e46e4724308901f8c70406c0e65, user_id=09caeb2fc12a47e08ed2793bb2be7f0a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:02.370825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316130-3cfe-49bf-b948-56988c05f0d9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:02.395243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 794/1631] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:02 2022] PUT /identity/v3/projects/99a49e46e4724308901f8c70406c0e65/users/09caeb2fc12a47e08ed2793bb2be7f0a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:02.406298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c64d2-9c3c-4ce8-a8db-9f447e3a6777 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.407303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c64d2-9c3c-4ce8-a8db-9f447e3a6777 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.413163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c64d2-9c3c-4ce8-a8db-9f447e3a6777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.416700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:02.417557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.418006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.418430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.419235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:02.421072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:02.468292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 838/1632] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:02.469275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:02.508195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66c49-14aa-4085-9530-0a63846c530c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:02.546506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ee8c64d2-9c3c-4ce8-a8db-9f447e3a6777 None None] MFA Rules not processed for user `09caeb2fc12a47e08ed2793bb2be7f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:02.548717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ee8c64d2-9c3c-4ce8-a8db-9f447e3a6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:02.634083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430552-1f10-4755-bba5-2c31bbb42af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:02.634772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430552-1f10-4755-bba5-2c31bbb42af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.635054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430552-1f10-4755-bba5-2c31bbb42af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.635332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430552-1f10-4755-bba5-2c31bbb42af4 admin admin] PATH_INFO: `/v3/projects/0cbb2233dbc5402ca1e32959a0958fd9/users/8a9b63da9ed6412c939a901cf1f0d3c8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.639668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b430552-1f10-4755-bba5-2c31bbb42af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbb2233dbc5402ca1e32959a0958fd9, user_id=8a9b63da9ed6412c939a901cf1f0d3c8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:02.642406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b430552-1f10-4755-bba5-2c31bbb42af4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:02.670388 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 839/1633] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:02 2022] PUT /identity/v3/projects/0cbb2233dbc5402ca1e32959a0958fd9/users/8a9b63da9ed6412c939a901cf1f0d3c8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:02.681600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ee880-801f-4a4e-9652-8f29e95c88c6 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.685731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ee880-801f-4a4e-9652-8f29e95c88c6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.687248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ee880-801f-4a4e-9652-8f29e95c88c6 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.696856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 840/1634] 10.222.0.25 () {54 vars in 912 bytes} [Sun Aug 7 18:20:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:02.699197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed4b4-99ad-4ac5-a9bd-9f5baf16469e None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.708590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed4b4-99ad-4ac5-a9bd-9f5baf16469e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.709060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed4b4-99ad-4ac5-a9bd-9f5baf16469e None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.718342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 841/1635] 10.222.0.25 () {54 vars in 912 bytes} [Sun Aug 7 18:20:02 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:02.720058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06149811-edda-451e-9c52-b41261691c52 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.720487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06149811-edda-451e-9c52-b41261691c52 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.720948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06149811-edda-451e-9c52-b41261691c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.742593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:02.759377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-06149811-edda-451e-9c52-b41261691c52 None None] MFA Rules not processed for user `8a9b63da9ed6412c939a901cf1f0d3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:02.760923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-06149811-edda-451e-9c52-b41261691c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:02.796731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 795/1636] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:02.803740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.803957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.805213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.870209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:02.874035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:02.930776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 842/1637] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:02.930776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:02.930776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:02.930776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:02.972167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:02.973544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.026823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:03.045584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 796/1638] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:03.046353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.074483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 843/1639] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:03.075729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.149947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433924a3-4852-4ec6-af89-3ab42c77260a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.161109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.161767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.162031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.162309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.170714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eeb62-156a-45df-a758-4858f1e87f2f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.180691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.182361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.188969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.189610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.189890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.190363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.221322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 844/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:03.325151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.327671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.361320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 797/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:03.365257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.374944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96a2f-7810-44d6-b9c7-136dd187f480 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.391929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.392910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.395447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.395959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.429361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.433702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.464434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 845/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:03.491155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.502674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e81e9-0c33-49bd-9f1e-0eae6228f175 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.512185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.513622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.513915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.514198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.550688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.555268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.585348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 798/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:03.758146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.774886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1a44c-925e-4c62-b6ef-c1eacf4f6821 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.784189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3a2f5-b882-4b8e-85a5-4e9bef312276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.784874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a2f5-b882-4b8e-85a5-4e9bef312276 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.785956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a2f5-b882-4b8e-85a5-4e9bef312276 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.787919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a2f5-b882-4b8e-85a5-4e9bef312276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.997750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3a2f5-b882-4b8e-85a5-4e9bef312276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.999944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3a2f5-b882-4b8e-85a5-4e9bef312276 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:04.014343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 846/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:04.955533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.008015 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:05.176893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bcf0d-dd44-428e-8138-f342e80054d9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.177695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bcf0d-dd44-428e-8138-f342e80054d9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.177965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bcf0d-dd44-428e-8138-f342e80054d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.189258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f123ee-01a2-4305-9877-51db26591c71 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.214215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:05.214873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.215170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.216728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] PATH_INFO: `/v3/users/d9fc4ef72acb449884e4a722097a4f96` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.217418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fc4ef72acb449884e4a722097a4f96)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:05.219322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:05.237181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-910bcf0d-dd44-428e-8138-f342e80054d9 None None] MFA Rules not processed for user `f617c22150914a45887bd29cf2d5feac`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.247780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-910bcf0d-dd44-428e-8138-f342e80054d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.331598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fc4ef72acb449884e4a722097a4f96'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.340121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:05.350014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fc4ef72acb449884e4a722097a4f96'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.350633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fc4ef72acb449884e4a722097a4f96'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.351626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fc4ef72acb449884e4a722097a4f96'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.377402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69398d70-71e6-43f1-940e-3bb419caffdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fc4ef72acb449884e4a722097a4f96'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.391236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 847/1645] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:05.392821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.393716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.394485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.419318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 799/1646] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:04 2022] DELETE /identity/v3/users/d9fc4ef72acb449884e4a722097a4f96 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:05.422772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] MFA Rules not processed for user `f617c22150914a45887bd29cf2d5feac`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.423626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.424137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.424261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.429867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.462504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.464288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.558292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 848/1647] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:05.559511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.564676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.614493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 800/1648] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:05.614493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.614493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.681795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad6dc-a703-4b9a-9254-37e812976458 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.691833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:05.692821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.693232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.693683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] PATH_INFO: `/v3/users/59d29247f612436393d093e5eb26ecfd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.695053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d29247f612436393d093e5eb26ecfd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:05.698215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: WARNING py.warnings [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:20:05.698215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: warnings.warn(msg) Aug 07 18:20:05.698215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: Aug 07 18:20:05.700092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:05.715472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:05.793063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b5c44-8561-43cc-a220-ae47b3b54fad None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.806057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:05.807896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.809200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.809727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.821804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d29247f612436393d093e5eb26ecfd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.823787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:05.826048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:05.844464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d29247f612436393d093e5eb26ecfd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.844697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 801/1649] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:05.845776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.847776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d29247f612436393d093e5eb26ecfd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.848137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.849429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d29247f612436393d093e5eb26ecfd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.867796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-529b7c33-8f10-4718-9ec9-863591230eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d29247f612436393d093e5eb26ecfd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.922793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 849/1650] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:05 2022] DELETE /identity/v3/users/59d29247f612436393d093e5eb26ecfd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:05.925733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.926133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.926569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.950233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6a02-2400-4910-aa19-9eb3f4e0a85e service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.952887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.955467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.963106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:06.096966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 850/1651] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:06.101629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.102270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.102548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.102818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.108957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:06.158735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.161266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856388b7-38d4-443d-9391-df6b46bcd74e service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.162794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.164450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:06.208254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb1e8-adb4-42e1-b47e-09fcc29fa27f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:06.226797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 802/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:06.232515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eabae-4d9d-4ee2-b329-3282a2bf4328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.233157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eabae-4d9d-4ee2-b329-3282a2bf4328 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.233522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eabae-4d9d-4ee2-b329-3282a2bf4328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.233685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eabae-4d9d-4ee2-b329-3282a2bf4328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.258193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eabae-4d9d-4ee2-b329-3282a2bf4328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.259805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eabae-4d9d-4ee2-b329-3282a2bf4328 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.302018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 851/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:07.322167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca066fe-d2d3-440d-a0f7-c79774965d48 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.323296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca066fe-d2d3-440d-a0f7-c79774965d48 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.323768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca066fe-d2d3-440d-a0f7-c79774965d48 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.325741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 803/1654] 10.222.0.25 () {54 vars in 912 bytes} [Sun Aug 7 18:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:07.335223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.335723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.335792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.437946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:07.439539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:07.457985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 852/1655] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:07.571122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca066fe-d2d3-440d-a0f7-c79774965d48 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.588290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca066fe-d2d3-440d-a0f7-c79774965d48 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.593896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.594703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.595084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.595472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.619562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.621068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.643093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 804/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:07.924167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.926094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:07.957556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dbc17-b997-4140-a62f-69211723c0f2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.973246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.974627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.976021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.976258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] PATH_INFO: `/v3/projects/ee9b6e97a1204094ab8ef87a9a4ba887` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.007239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9b6e97a1204094ab8ef87a9a4ba887)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:08.023813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:08.049597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:08.053273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.099680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693cfc9-cb40-445f-ba4e-b37cf3112044 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:08.112041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:08.115003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.115003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.115003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] PATH_INFO: `/v3/projects/e995096b6dfd452287ca29000479b873` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.120087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e995096b6dfd452287ca29000479b873)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:08.124371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:20:08.124371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: warnings.warn(msg) Aug 07 18:20:08.124371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: Aug 07 18:20:08.127476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:08.185671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9b6e97a1204094ab8ef87a9a4ba887', 'request_id': 'req-642a1173-38a2-4f12-84a2-9e1782b2790c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.202741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9b6e97a1204094ab8ef87a9a4ba887', 'request_id': 'req-642a1173-38a2-4f12-84a2-9e1782b2790c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.228814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9b6e97a1204094ab8ef87a9a4ba887', 'request_id': 'req-642a1173-38a2-4f12-84a2-9e1782b2790c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.267864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] The token cache is being invalidate because project ee9b6e97a1204094ab8ef87a9a4ba887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:08.270635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.272544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-642a1173-38a2-4f12-84a2-9e1782b2790c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.277938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 853/1657] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:07 2022] DELETE /identity/v3/projects/ee9b6e97a1204094ab8ef87a9a4ba887 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:08.286447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca085f8-d42f-4b6f-9af2-e961603b0f31 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.287203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca085f8-d42f-4b6f-9af2-e961603b0f31 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.287780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca085f8-d42f-4b6f-9af2-e961603b0f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.319894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e995096b6dfd452287ca29000479b873', 'request_id': 'req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.343512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e995096b6dfd452287ca29000479b873', 'request_id': 'req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.355008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:08.356011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8ca085f8-d42f-4b6f-9af2-e961603b0f31 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.359012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8ca085f8-d42f-4b6f-9af2-e961603b0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.366421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e995096b6dfd452287ca29000479b873', 'request_id': 'req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.448834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] The token cache is being invalidate because project e995096b6dfd452287ca29000479b873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:08.451106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.456683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.466232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 805/1658] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:08 2022] DELETE /identity/v3/projects/e995096b6dfd452287ca29000479b873 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:08.469903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:08.473772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.619686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 854/1659] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:08.632136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b045a35-9c9e-412d-b950-4fc86dd9a72f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.638331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b045a35-9c9e-412d-b950-4fc86dd9a72f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.638761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b045a35-9c9e-412d-b950-4fc86dd9a72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.661166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:08.714601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9b045a35-9c9e-412d-b950-4fc86dd9a72f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.719007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9b045a35-9c9e-412d-b950-4fc86dd9a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.751051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1f267-1daf-4725-8bb6-2e3fb9112b85 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:08.762951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 855/1660] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:08.764996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3afb1-b2da-4d09-9d40-5f5be993084c None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.767186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3afb1-b2da-4d09-9d40-5f5be993084c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.773958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3afb1-b2da-4d09-9d40-5f5be993084c None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.775675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:08.777938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.782969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 856/1661] 10.222.0.25 () {54 vars in 961 bytes} [Sun Aug 7 18:20:08 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:08.783573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.785916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] PATH_INFO: `/v3/users/09caeb2fc12a47e08ed2793bb2be7f0a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.787156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3afb1-b2da-4d09-9d40-5f5be993084c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:08.788634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=09caeb2fc12a47e08ed2793bb2be7f0a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:08.796088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:08.849728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3afb1-b2da-4d09-9d40-5f5be993084c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:08.877747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:08.879118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.879530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.879688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.880754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:08.880937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:08.883102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0caa30-edac-481b-84d3-33f902c13654 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:08.899677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 857/1662] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:08.901481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.901768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.902039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.958099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.965087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.009269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09caeb2fc12a47e08ed2793bb2be7f0a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.022727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09caeb2fc12a47e08ed2793bb2be7f0a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.023441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09caeb2fc12a47e08ed2793bb2be7f0a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.024098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09caeb2fc12a47e08ed2793bb2be7f0a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.039559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09caeb2fc12a47e08ed2793bb2be7f0a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.106383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 806/1663] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:08 2022] DELETE /identity/v3/users/09caeb2fc12a47e08ed2793bb2be7f0a => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:09.106383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.111275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.189779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 858/1664] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Aug 7 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:09.199580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.214342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01587ae8-f891-4851-9c45-554e5ae6e644 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.329790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98b35-f255-4347-88b6-3e5512ad90eb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.339376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.340512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.341031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.342059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.342968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.345341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.374355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.375614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.376104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.376742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.379640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:09.380066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.394601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.397387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.400984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 807/1665] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:09 2022] POST /identity/v3/projects => generated 373 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:09.405251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.411171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 859/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:09.544267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e7ef-c495-4839-b786-a148d4f16dd0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.577981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.578587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.578867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.579141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.580014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.583332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.655483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 808/1667] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:09 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:09.658104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.677749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca266a-90a7-4d3f-aeaa-b1af13a59ece service placement] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.706773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.712128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.713336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.716683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.722114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.739086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.770129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.775681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 860/1668] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:09.787776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f5bc-65f2-4edf-a9d1-48cf97f1d261 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.801555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f399-c81d-4811-979f-6d93a4c601f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.802307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f399-c81d-4811-979f-6d93a4c601f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.802799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f399-c81d-4811-979f-6d93a4c601f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.803219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f399-c81d-4811-979f-6d93a4c601f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.803985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f399-c81d-4811-979f-6d93a4c601f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.805742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f399-c81d-4811-979f-6d93a4c601f1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.835895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.849632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 809/1669] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:09.853902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7700941-0871-4eec-b4cb-871ebd37f3b3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.872899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.873971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.874963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.876091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] PATH_INFO: `/v3/projects/0b75cf1cd421471ca06440476e7becb6/users/c87cc6ed568b41499475d9b8a6eea663/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.919919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b75cf1cd421471ca06440476e7becb6, user_id=c87cc6ed568b41499475d9b8a6eea663, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.928105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.953988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 861/1670] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:09 2022] PUT /identity/v3/projects/0b75cf1cd421471ca06440476e7becb6/users/c87cc6ed568b41499475d9b8a6eea663/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:09.965520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6eec-ec47-470e-8176-258313aad3de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.965954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6eec-ec47-470e-8176-258313aad3de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.966337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6eec-ec47-470e-8176-258313aad3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:10.063331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-809e6eec-ec47-470e-8176-258313aad3de None None] MFA Rules not processed for user `c87cc6ed568b41499475d9b8a6eea663`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:10.068283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-809e6eec-ec47-470e-8176-258313aad3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:10.125639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:10.129731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:10.247589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:10.347279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 810/1671] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:10.352794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6eec-ec47-470e-8176-258313aad3de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:10.391430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825728fd-fe84-4f61-b019-da581285f03b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:10.421212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6eec-ec47-470e-8176-258313aad3de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:10.426004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:10.431859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:10.432897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:10.433515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] PATH_INFO: `/v3/users/c39be2efcf0e45eb88e5a1b478feac27` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:10.436035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39be2efcf0e45eb88e5a1b478feac27)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:10.440083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:10.445276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:10.447637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:10.448101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:10.449010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:10.452291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:10.473096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:10.548972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 811/1672] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:10 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:10.548972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:10.553832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:10.589784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39be2efcf0e45eb88e5a1b478feac27'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:10.614993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39be2efcf0e45eb88e5a1b478feac27'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:10.619850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39be2efcf0e45eb88e5a1b478feac27'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:10.623255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39be2efcf0e45eb88e5a1b478feac27'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:10.645610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39be2efcf0e45eb88e5a1b478feac27'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:10.683588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 862/1673] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:10 2022] DELETE /identity/v3/users/c39be2efcf0e45eb88e5a1b478feac27 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:10.684866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:10.688387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:10.690256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:10.762811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6907c-cbae-41be-9537-d6f4a7fd0784 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:10.937639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65272b8-59b2-44c3-b9fb-b166768c1089 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:10.947850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:10.948539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:10.948848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:10.949126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] PATH_INFO: `/v3/users/20281cc82b0a42fcaa139e837527f61b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:10.949921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30141acc-8250-47a9-91a5-90b7abf3dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:10.950985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=20281cc82b0a42fcaa139e837527f61b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:10.951761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30141acc-8250-47a9-91a5-90b7abf3dbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:10.952222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30141acc-8250-47a9-91a5-90b7abf3dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:10.952703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30141acc-8250-47a9-91a5-90b7abf3dbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:10.953708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30141acc-8250-47a9-91a5-90b7abf3dbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:10.959271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30141acc-8250-47a9-91a5-90b7abf3dbd5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:10.961303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:11.024898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 863/1674] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:10 2022] POST /identity/v3/users => generated 291 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:11.026550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.028912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.030333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.048620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20281cc82b0a42fcaa139e837527f61b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.066941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20281cc82b0a42fcaa139e837527f61b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.068979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20281cc82b0a42fcaa139e837527f61b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.069680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20281cc82b0a42fcaa139e837527f61b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.081043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:11.082734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.100597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20281cc82b0a42fcaa139e837527f61b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.110293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 864/1675] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:11.113853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:11.117737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.146431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6cd57-7ff6-442a-9325-cefd97617bd3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:11.152917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 812/1676] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:10 2022] DELETE /identity/v3/users/20281cc82b0a42fcaa139e837527f61b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:11.154966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:11.193862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.283052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:11.360943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:11.361830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.362808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.363235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] PATH_INFO: `/v3/projects/99a49e46e4724308901f8c70406c0e65` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.365331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a49e46e4724308901f8c70406c0e65)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:11.367720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:11.372127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a6d15-cbd6-403d-816e-a6659dcfc0cf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:11.379019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e3d6d-1ef8-43b4-8a7a-7616e3296c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:11.380237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e3d6d-1ef8-43b4-8a7a-7616e3296c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.380788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e3d6d-1ef8-43b4-8a7a-7616e3296c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.381204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e3d6d-1ef8-43b4-8a7a-7616e3296c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.382410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e3d6d-1ef8-43b4-8a7a-7616e3296c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:11.385184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e3d6d-1ef8-43b4-8a7a-7616e3296c7f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:11.432806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 813/1677] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:11.432806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.432806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.432806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.441756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:11.462415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:11.463832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.500908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a49e46e4724308901f8c70406c0e65', 'request_id': 'req-dd3a6c41-b91c-463e-9124-93b599e65d97'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.513738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a49e46e4724308901f8c70406c0e65', 'request_id': 'req-dd3a6c41-b91c-463e-9124-93b599e65d97'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.546070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a49e46e4724308901f8c70406c0e65', 'request_id': 'req-dd3a6c41-b91c-463e-9124-93b599e65d97'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.559939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 814/1678] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:11.561479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:11.566724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.574142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] The token cache is being invalidate because project 99a49e46e4724308901f8c70406c0e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:11.574604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.577095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.581534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 865/1679] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:11 2022] DELETE /identity/v3/projects/99a49e46e4724308901f8c70406c0e65 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:11.582792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:11.587870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.623903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a6c41-b91c-463e-9124-93b599e65d97 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:11.637542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bbe41-5cbe-466f-89fe-83cc013c55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:11.638647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bbe41-5cbe-466f-89fe-83cc013c55b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.639212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bbe41-5cbe-466f-89fe-83cc013c55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.639640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bbe41-5cbe-466f-89fe-83cc013c55b8 admin admin] PATH_INFO: `/v3/projects/80b4a722f34a4f779f97f160bd457be5/users/d4ea54e5cdb94b208b77558f43be9452/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.681719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bbe41-5cbe-466f-89fe-83cc013c55b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b4a722f34a4f779f97f160bd457be5, user_id=d4ea54e5cdb94b208b77558f43be9452, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:11.685540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bbe41-5cbe-466f-89fe-83cc013c55b8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:11.716249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 866/1680] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:11 2022] PUT /identity/v3/projects/80b4a722f34a4f779f97f160bd457be5/users/d4ea54e5cdb94b208b77558f43be9452/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:11.717821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.718791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.720034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.764681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31858b7c-5522-4794-8c53-35cc391620f5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:11.798231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:11.799954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.946964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:11.947686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.948043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.948439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.970490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.094135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 867/1681] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:12.095024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.105804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.149811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dff04d-6cda-4611-9029-4fabb87024eb None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.154948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.159641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.160265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.160540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.160882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.162263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.169339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.203721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 815/1682] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:12.205048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.209928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.212156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf0a9f-fa5a-44c0-b323-13d6700157cd service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.227198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc0e1e-e3bd-473a-946a-d610691bc946 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.246537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.246925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 868/1683] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:12.247567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.247954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.248280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.248531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.248744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.249130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.249587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.259882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.281206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:12.301051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 816/1684] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:12.303319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.307174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:12.308601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.329304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb23c-9696-4ac9-a2c4-36ae40c77da2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.345282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557d30-65e5-4abc-93b0-90cd418f954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.345282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557d30-65e5-4abc-93b0-90cd418f954c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.345282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557d30-65e5-4abc-93b0-90cd418f954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.345619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557d30-65e5-4abc-93b0-90cd418f954c admin admin] PATH_INFO: `/v3/projects/80b4a722f34a4f779f97f160bd457be5/users/d4ea54e5cdb94b208b77558f43be9452/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.349975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53557d30-65e5-4abc-93b0-90cd418f954c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b4a722f34a4f779f97f160bd457be5, user_id=d4ea54e5cdb94b208b77558f43be9452, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.361088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 869/1685] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:12.366090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.372010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53557d30-65e5-4abc-93b0-90cd418f954c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.395675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d641e-2c8b-4f9c-b322-44011cd8c1a6 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.413048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.413992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.414112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 817/1686] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:12 2022] PUT /identity/v3/projects/80b4a722f34a4f779f97f160bd457be5/users/d4ea54e5cdb94b208b77558f43be9452/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:12.415036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.415524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.416369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:12.417094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.418994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.426706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.426984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.427271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.476091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 870/1687] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:12.480377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.514294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602080d3-b36f-45a5-b0a2-65565c30a5f4 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.517560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] MFA Rules not processed for user `d4ea54e5cdb94b208b77558f43be9452`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:12.519387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.526335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:12.731039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.731665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.731942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.732209 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.732951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.734974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.772584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 818/1688] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:12.785562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.794569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.879052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 871/1689] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:12.882780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.009516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d68be-fb7e-414e-8563-6ace2a60676b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.100485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74d910-f661-472a-a7fd-db987abc0645 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.122009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.122428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.122702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.122967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.123603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.125948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.126221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.126972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.127143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.127381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.197647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 872/1690] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:13.203562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.232078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92ed2c-cf02-4032-be20-94c5ea5600bb admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.246882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.249378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.249809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.250567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.252021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:13.254192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.262480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.295752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 873/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:13.298081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.313886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.315506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.330569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1406b-6906-4111-9cf0-d1fa0839b080 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.348213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750890a-b5d8-4fed-9ec6-e815aca19c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.348799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 819/1692] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:13.350292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750890a-b5d8-4fed-9ec6-e815aca19c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.350583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750890a-b5d8-4fed-9ec6-e815aca19c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.351070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750890a-b5d8-4fed-9ec6-e815aca19c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.353166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750890a-b5d8-4fed-9ec6-e815aca19c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.359085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750890a-b5d8-4fed-9ec6-e815aca19c37 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.385940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 874/1693] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:13.390138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.410173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcffc8-8143-41c5-8e1e-19f396bb324d service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.432083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.433470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.433964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.434446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] PATH_INFO: `/v3/projects/ee719164502347158ea5a7e7580cc76e/users/a53e41397aa44c3fb3654944010ef6bd/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.441435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bee7e-1462-4f1e-8543-3ecc6e7819af None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.442049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bee7e-1462-4f1e-8543-3ecc6e7819af None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.442524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bee7e-1462-4f1e-8543-3ecc6e7819af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.534205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee719164502347158ea5a7e7580cc76e, user_id=a53e41397aa44c3fb3654944010ef6bd, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.540590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.574024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 820/1694] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:13 2022] PUT /identity/v3/projects/ee719164502347158ea5a7e7580cc76e/users/a53e41397aa44c3fb3654944010ef6bd/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:13.574847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.594581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-656bee7e-1462-4f1e-8543-3ecc6e7819af None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:13.596792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-656bee7e-1462-4f1e-8543-3ecc6e7819af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:13.671370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:13.729819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7aec-eadb-4f7d-820d-ecc77d939ec9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.744271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.746027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.748394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.748826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.751288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:13.827947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 875/1695] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 07 18:20:13.830774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.831093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.831412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.897853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.899492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d04510-4eb7-49f1-b828-334d3b506048 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.910646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] MFA Rules not processed for user `a53e41397aa44c3fb3654944010ef6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:13.911875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:13.949291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 821/1696] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:13.950811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.951076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.951350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.084834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] MFA Rules not processed for user `17943c8309fc4e97b180373b320595f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:14.086280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.093141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 876/1697] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:14.094432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.235913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b72ba-db13-4780-8362-5a21bc8bb0d0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.246824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8dc96-20f8-4590-ae62-f3875423c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.248191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8dc96-20f8-4590-ae62-f3875423c056 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.248786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8dc96-20f8-4590-ae62-f3875423c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.250166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8dc96-20f8-4590-ae62-f3875423c056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.251166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8dc96-20f8-4590-ae62-f3875423c056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.251549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:14.255807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8dc96-20f8-4590-ae62-f3875423c056 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.267301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 822/1698] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:14.268169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.271654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.311168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 877/1699] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:14.315964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.316295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.318692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.369315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] MFA Rules not processed for user `17943c8309fc4e97b180373b320595f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:14.376321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.483098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675333b-d486-480f-afdd-07f5a2dd8dbe None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.562574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.563289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.563576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.563844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.574289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:14.626356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 878/1700] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:14.630776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.649744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.651357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.677004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 823/1701] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:20:14.678003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.679747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.837821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:14.874126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad083-5162-471d-8e4b-3aefb9b6ba57 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.888661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.890696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.891431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.893197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.894790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.898421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.952621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 879/1702] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/users => generated 298 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:14.953474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.958492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.991163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a2d9-b30f-4fd1-8062-a2ceaad90d63 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.004377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.005358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.008988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.009448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] PATH_INFO: `/v3/projects/a19928ef49704b53a05bff96b4c1b505` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.010944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19928ef49704b53a05bff96b4c1b505)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.019108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.026330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fde51f-e62a-4d55-a7a8-f939abb6e3ae service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.044576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.045243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.045525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.045803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] PATH_INFO: `/v3/projects/4a0184e01f664353bc5ae12f75107b07` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.052989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0184e01f664353bc5ae12f75107b07)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.058755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.200434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19928ef49704b53a05bff96b4c1b505', 'request_id': 'req-efebd6e1-b36c-4c50-b00a-074aa0eead3b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.226377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19928ef49704b53a05bff96b4c1b505', 'request_id': 'req-efebd6e1-b36c-4c50-b00a-074aa0eead3b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.246235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19928ef49704b53a05bff96b4c1b505', 'request_id': 'req-efebd6e1-b36c-4c50-b00a-074aa0eead3b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.273731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0184e01f664353bc5ae12f75107b07', 'request_id': 'req-e0282041-5dde-4667-9ad3-ac6d487756ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.286385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] The token cache is being invalidate because project a19928ef49704b53a05bff96b4c1b505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:15.286736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.290679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.298193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0184e01f664353bc5ae12f75107b07', 'request_id': 'req-e0282041-5dde-4667-9ad3-ac6d487756ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.300890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 880/1703] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:14 2022] DELETE /identity/v3/projects/a19928ef49704b53a05bff96b4c1b505 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:15.301876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.309410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.312177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0184e01f664353bc5ae12f75107b07', 'request_id': 'req-e0282041-5dde-4667-9ad3-ac6d487756ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.357858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] The token cache is being invalidate because project 4a0184e01f664353bc5ae12f75107b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:15.358168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.363546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.366776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 824/1704] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:14 2022] DELETE /identity/v3/projects/4a0184e01f664353bc5ae12f75107b07 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:15.369706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.373976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.563007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:15.570285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebd6e1-b36c-4c50-b00a-074aa0eead3b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.628960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282041-5dde-4667-9ad3-ac6d487756ae admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.659025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21158eea-1450-4b38-8b43-74a28989ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.660198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21158eea-1450-4b38-8b43-74a28989ae69 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.660715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21158eea-1450-4b38-8b43-74a28989ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.661097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21158eea-1450-4b38-8b43-74a28989ae69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.662039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21158eea-1450-4b38-8b43-74a28989ae69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.665246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21158eea-1450-4b38-8b43-74a28989ae69 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.683557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.685409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.685897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.686314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.689424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.710938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 825/1705] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:15.712392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.714021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.714578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.782582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:15.785879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.810909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 826/1706] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:15.811899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.816518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.827393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.830225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.846554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 881/1707] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:15.847946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.848144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f70499-9f4d-419f-bd2a-839a8093a372 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.857735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.860187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.860476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.860775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] PATH_INFO: `/v3/users/8a9b63da9ed6412c939a901cf1f0d3c8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.864231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9b63da9ed6412c939a901cf1f0d3c8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.864714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa84e-13f0-454b-8199-2129fede89ff service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.868170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.874683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92384152-c685-456d-919a-988ee7bcfe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.876272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384152-c685-456d-919a-988ee7bcfe63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.876837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384152-c685-456d-919a-988ee7bcfe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.877404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92384152-c685-456d-919a-988ee7bcfe63 admin admin] PATH_INFO: `/v3/projects/605f264327684f42a8d621ffc4071e74/users/4748408e98e646f1b648b3e4a4ac018e/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.971578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92384152-c685-456d-919a-988ee7bcfe63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605f264327684f42a8d621ffc4071e74, user_id=4748408e98e646f1b648b3e4a4ac018e, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.989663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:15.999280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92384152-c685-456d-919a-988ee7bcfe63 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.035179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9b63da9ed6412c939a901cf1f0d3c8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:16.059048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 882/1708] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:15 2022] PUT /identity/v3/projects/605f264327684f42a8d621ffc4071e74/users/4748408e98e646f1b648b3e4a4ac018e/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:16.070568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9b63da9ed6412c939a901cf1f0d3c8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:16.071747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9b63da9ed6412c939a901cf1f0d3c8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:16.072635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9b63da9ed6412c939a901cf1f0d3c8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:16.078836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.079179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.079598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.083701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9b63da9ed6412c939a901cf1f0d3c8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:16.159927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 827/1709] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:15 2022] DELETE /identity/v3/users/8a9b63da9ed6412c939a901cf1f0d3c8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:16.164046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.167665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.180532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.182294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.396148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 883/1710] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:16.399862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.410247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb18e8-0c84-4401-b944-f0db82d06a7a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.424687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088480d9-6ba2-468b-bca5-a0f3aff988cc None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.430741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.431342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.431647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.432015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.432802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:16.433107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.435165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.449231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.450024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.450310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.450586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.451232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.452939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.472615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 884/1711] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:16.477514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.484235 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 828/1712] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:16.489914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.502742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:16.511075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6e21b-c8cc-4365-a6b2-de9da3236a5e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.523535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6df92-c64e-4b0e-ab76-d2fece9e34a7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.532702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.533642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.534123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.534456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.535578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.539421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.550819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cdb5c-d2c2-4b5f-bfdf-0de06d7321c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.550819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cdb5c-d2c2-4b5f-bfdf-0de06d7321c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.550819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cdb5c-d2c2-4b5f-bfdf-0de06d7321c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.550819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cdb5c-d2c2-4b5f-bfdf-0de06d7321c5 admin admin] PATH_INFO: `/v3/projects/605f264327684f42a8d621ffc4071e74/users/4748408e98e646f1b648b3e4a4ac018e/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.552323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cdb5c-d2c2-4b5f-bfdf-0de06d7321c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605f264327684f42a8d621ffc4071e74, user_id=4748408e98e646f1b648b3e4a4ac018e, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.560695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cdb5c-d2c2-4b5f-bfdf-0de06d7321c5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.597512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 829/1713] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:16 2022] PUT /identity/v3/projects/605f264327684f42a8d621ffc4071e74/users/4748408e98e646f1b648b3e4a4ac018e/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:16.600722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.601027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.601303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.628023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 885/1714] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:16.633009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.693098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] MFA Rules not processed for user `4748408e98e646f1b648b3e4a4ac018e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.694372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.803741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6a31-7248-4f34-ba15-e01fba961a5e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.817649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.819687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.821188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.821566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.822124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.828656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.881820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 830/1715] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:16.882822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.889876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.890054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 886/1716] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:16.891080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.916095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de31301-bb33-40ee-a062-2d1b9d56f27c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.931033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.931726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.932064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.932338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.933071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.937357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.953739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:16.969105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 887/1717] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:16.973460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.998857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c8b6-7bf3-4f68-b9dc-cf82300cc022 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.015451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.016135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.016490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.017183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.017500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.023182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.030636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6819d0a-ef8d-49ee-b83e-c3a849dc33fb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.042519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc784ace-3364-41cf-b307-deac832e738c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.042926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc784ace-3364-41cf-b307-deac832e738c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.043200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc784ace-3364-41cf-b307-deac832e738c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.043469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc784ace-3364-41cf-b307-deac832e738c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.054394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 888/1718] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:17.056099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.066565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc784ace-3364-41cf-b307-deac832e738c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.068492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc784ace-3364-41cf-b307-deac832e738c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.079950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3281b4-2781-40ec-a740-dc3a7adfa2a4 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.101565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.103238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.103514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.103786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] PATH_INFO: `/v3/projects/66168ed4c826440a9abe6c5bb1edcc5a/users/cfd28a3ba13a49169970ab12d2e461e5/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.108663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 831/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:17.207532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66168ed4c826440a9abe6c5bb1edcc5a, user_id=cfd28a3ba13a49169970ab12d2e461e5, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.211443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.262226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 889/1720] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:17 2022] PUT /identity/v3/projects/66168ed4c826440a9abe6c5bb1edcc5a/users/cfd28a3ba13a49169970ab12d2e461e5/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:17.281389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411001-d023-41a9-a332-890532f01614 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.283321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411001-d023-41a9-a332-890532f01614 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.283986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411001-d023-41a9-a332-890532f01614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.373908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.415073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a7411001-d023-41a9-a332-890532f01614 None None] MFA Rules not processed for user `cfd28a3ba13a49169970ab12d2e461e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:17.416320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a7411001-d023-41a9-a332-890532f01614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.491897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd82f-2c24-4c16-96d1-867faf1ff0b8 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.496747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.497782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.498265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.498889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.500982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.562259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:17.613720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.615326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.644319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 890/1721] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:17.648400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.657642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.693932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 832/1722] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:17.714777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411001-d023-41a9-a332-890532f01614 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.716333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a7411001-d023-41a9-a332-890532f01614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.955629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8279b2-e957-4fdc-9ba4-209065dd6513 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.985465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.986183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.986463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.986737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] PATH_INFO: `/v3/projects/0cbb2233dbc5402ca1e32959a0958fd9` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.995937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbb2233dbc5402ca1e32959a0958fd9)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.997894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.014376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411001-d023-41a9-a332-890532f01614 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.050488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eff38-ce00-41e2-8fb0-965d1365cb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.051191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eff38-ce00-41e2-8fb0-965d1365cb59 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.051473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eff38-ce00-41e2-8fb0-965d1365cb59 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.051748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eff38-ce00-41e2-8fb0-965d1365cb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.097212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eff38-ce00-41e2-8fb0-965d1365cb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.098929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eff38-ce00-41e2-8fb0-965d1365cb59 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.144466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 833/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:18.189106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbb2233dbc5402ca1e32959a0958fd9', 'request_id': 'req-28a85d85-b5bc-4a53-8333-08e6415d0738'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.220982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbb2233dbc5402ca1e32959a0958fd9', 'request_id': 'req-28a85d85-b5bc-4a53-8333-08e6415d0738'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.243647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbb2233dbc5402ca1e32959a0958fd9', 'request_id': 'req-28a85d85-b5bc-4a53-8333-08e6415d0738'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.293984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] The token cache is being invalidate because project 0cbb2233dbc5402ca1e32959a0958fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:18.294278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.299082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28a85d85-b5bc-4a53-8333-08e6415d0738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.309528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 891/1724] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:17 2022] DELETE /identity/v3/projects/0cbb2233dbc5402ca1e32959a0958fd9 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:18.313424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb98f-e978-4220-8be5-50b55e8ec61b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.313713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb98f-e978-4220-8be5-50b55e8ec61b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.313992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb98f-e978-4220-8be5-50b55e8ec61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.375548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-465fb98f-e978-4220-8be5-50b55e8ec61b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:18.382085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-465fb98f-e978-4220-8be5-50b55e8ec61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.479681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.479964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.480361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.554077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] MFA Rules not processed for user `17943c8309fc4e97b180373b320595f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:18.556328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.592033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:18.715856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 834/1725] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:18.723273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.723709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.724353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.845032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:18.846821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.918471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 835/1726] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:18.922377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:18.936070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 892/1727] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:18.965193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f7075-58d9-4747-80f8-190623fa0d52 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.977579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.980312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.981023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.981577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.988536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:18.989279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.995415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.038958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.039842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 836/1728] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:19.062302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007e6e-1970-4206-9c71-3c266bb4640b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.103060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.113175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.113617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.114088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.115595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.122940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.156036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:19.184470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.185769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 893/1729] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:19 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:19.201901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1677f5e-e408-4147-8e94-530e3d6514d9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.467493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc92cb-2929-47d5-ae4d-e7fe893501b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.468739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc92cb-2929-47d5-ae4d-e7fe893501b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.481078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc92cb-2929-47d5-ae4d-e7fe893501b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.481352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc92cb-2929-47d5-ae4d-e7fe893501b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.482122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc92cb-2929-47d5-ae4d-e7fe893501b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.484675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc92cb-2929-47d5-ae4d-e7fe893501b9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.555068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 837/1730] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:19 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:19.558376 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.582957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafb669-9158-4de0-abc7-ad4c3982285e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.601485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a40b64-93cc-4e8e-ae58-e0b474f79dd6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.601702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a40b64-93cc-4e8e-ae58-e0b474f79dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.602146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a40b64-93cc-4e8e-ae58-e0b474f79dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.649405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.652082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.652663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.653138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.661771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.667115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.720116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-05a40b64-93cc-4e8e-ae58-e0b474f79dd6 None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:19.724518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 894/1731] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:19.738138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05a40b64-93cc-4e8e-ae58-e0b474f79dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:19.743728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.828059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c58d6-e40b-48c0-8558-149879e11735 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.869435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.878070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.878373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.878733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.879286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.908235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.989026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 895/1732] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:19.994400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:20.062315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f052b6-c10b-4423-b6c2-514e869c2f1d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:20.106821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:20.107512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:20.107792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:20.108066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] PATH_INFO: `/v3/projects/1b3762fcdc144e10b3fef84bba375915/users/6fdc0f5c22f544a7a40a5ecb688516da/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:20.173914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 838/1733] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Aug 7 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:20.229569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3762fcdc144e10b3fef84bba375915, user_id=6fdc0f5c22f544a7a40a5ecb688516da, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:20.244257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:20.326835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 896/1734] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:19 2022] PUT /identity/v3/projects/1b3762fcdc144e10b3fef84bba375915/users/6fdc0f5c22f544a7a40a5ecb688516da/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:20.340191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:20.340650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:20.340980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:20.463655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] MFA Rules not processed for user `6fdc0f5c22f544a7a40a5ecb688516da`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:20.468697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:20.662212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:20.664362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:20.701807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:20.790812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 839/1735] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:20.793814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:20.950305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693bc80-c7f0-4ca2-a3e6-30f34aae5b00 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:20.968478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:20.969137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:20.969407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:20.973815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:21.015951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa1040-0a70-49d8-b730-08760714d68a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:21.017782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:21.029184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:21.030233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:21.031155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:21.033217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:21.035178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:21.036873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:21.039789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:21.080395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 897/1736] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:21.141686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:21.142548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 840/1737] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:20 2022] POST /identity/v3/projects => generated 385 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:21.206311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2ad32-a596-4a24-b796-b59bfdda5666 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:21.384245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:21.387867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:21.388493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:21.389046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:21.392090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:21.395986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:21.520034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 898/1738] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:21 2022] POST /identity/v3/users => generated 299 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:21.523245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:21.542139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6ffc5-879a-430e-be1f-b1d596024c56 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:21.558989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:21.559871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:21.560291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:21.561068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:21.561904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:21.571198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:21.620307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:21.623408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 841/1739] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:21.653182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054b65-fb39-43b4-be03-4148a9e49a84 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:21.693236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:21.705533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:21.708781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:21.709507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] PATH_INFO: `/v3/projects/2a5b7f7ec01348db9a6c1c51932eb35d/users/e455a4bec8e14789990c449322447e49/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:21.752194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5b7f7ec01348db9a6c1c51932eb35d, user_id=e455a4bec8e14789990c449322447e49, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:21.758064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:21.794430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 899/1740] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:21 2022] PUT /identity/v3/projects/2a5b7f7ec01348db9a6c1c51932eb35d/users/e455a4bec8e14789990c449322447e49/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:21.799142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:21.850198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a108-b651-4ecf-8f7f-eebbf2bf33fa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:22.042071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:22.042857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:22.043190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:22.043424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:22.044334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:22.053052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:22.076645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 842/1741] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:22.081903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:22.115790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f6689-c8af-4993-9467-351cf16c8cc0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:22.120506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8bc1-2b8d-4c32-9207-5c24547ae1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:22.121640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8bc1-2b8d-4c32-9207-5c24547ae1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:22.121922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8bc1-2b8d-4c32-9207-5c24547ae1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:22.122193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8bc1-2b8d-4c32-9207-5c24547ae1ae admin admin] PATH_INFO: `/v3/projects/2a5b7f7ec01348db9a6c1c51932eb35d/users/e455a4bec8e14789990c449322447e49/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:22.125335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f8bc1-2b8d-4c32-9207-5c24547ae1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5b7f7ec01348db9a6c1c51932eb35d, user_id=e455a4bec8e14789990c449322447e49, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:22.128538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f8bc1-2b8d-4c32-9207-5c24547ae1ae admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:22.149157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:22.151504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:22.175849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3392-d323-4937-a873-5718214c13f2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:22.206348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 900/1742] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:22 2022] PUT /identity/v3/projects/2a5b7f7ec01348db9a6c1c51932eb35d/users/e455a4bec8e14789990c449322447e49/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:22.213497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:22.214494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:22.215120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:22.235367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:22.294826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] MFA Rules not processed for user `e455a4bec8e14789990c449322447e49`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:22.296686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:22.419574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:22.419985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:22.422023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:22.422327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] PATH_INFO: `/v3/users/a53e41397aa44c3fb3654944010ef6bd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:22.426086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53e41397aa44c3fb3654944010ef6bd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:22.447483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:22.453440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:22.677989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53e41397aa44c3fb3654944010ef6bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:22.711031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53e41397aa44c3fb3654944010ef6bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:22.713234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53e41397aa44c3fb3654944010ef6bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:22.714520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53e41397aa44c3fb3654944010ef6bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:22.744451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 901/1743] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:22.745706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:22.754181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:22.761638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0b0446f1-6eac-42db-b775-53f236927317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53e41397aa44c3fb3654944010ef6bd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:22.842611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 843/1744] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:22 2022] DELETE /identity/v3/users/a53e41397aa44c3fb3654944010ef6bd => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:22.850560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:22.851074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:22.851486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:22.931374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:22.939202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.075030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5925991-4253-49dd-b634-fbc4c07fce21 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:23.185587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 844/1745] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:23.279374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:23.280526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:23.280984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:23.281405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:23.291063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.380419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:23.383886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.464296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:23.486096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:23.497892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:23.528364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 902/1746] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:23.603317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c9109-24c3-4598-bee3-2f2427c209d7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:23.614807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:23.617318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.620246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:23.621078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:23.621365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:23.621643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:23.658296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:23.662403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:23.684174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19eb5-404b-46fd-bd79-bb978507645f service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:23.706941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 845/1747] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:23.713544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:23.713911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:23.714646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:23.715068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:23.715558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] PATH_INFO: `/v3/users/6fdc0f5c22f544a7a40a5ecb688516da` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:23.716092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.717106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdc0f5c22f544a7a40a5ecb688516da)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:23.719435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:23.760888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4b5d7-1c80-42cf-8862-9c5a1a0f6043 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:23.793176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:23.793994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:23.794288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:23.794570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] PATH_INFO: `/v3/users/cfd28a3ba13a49169970ab12d2e461e5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:23.805673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdc0f5c22f544a7a40a5ecb688516da'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.808597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd28a3ba13a49169970ab12d2e461e5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:23.816230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:23.828456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdc0f5c22f544a7a40a5ecb688516da'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.829251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdc0f5c22f544a7a40a5ecb688516da'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.829911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdc0f5c22f544a7a40a5ecb688516da'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.843587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-86658284-8a72-42f9-8ad2-9902072465be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdc0f5c22f544a7a40a5ecb688516da'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.885048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:23.915391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 903/1748] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:23 2022] DELETE /identity/v3/users/6fdc0f5c22f544a7a40a5ecb688516da => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:23.921305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:23.928015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:23.932235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:23.963584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd28a3ba13a49169970ab12d2e461e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.978163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd28a3ba13a49169970ab12d2e461e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.979162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd28a3ba13a49169970ab12d2e461e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.981345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd28a3ba13a49169970ab12d2e461e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:23.998089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a0e9062b-57a6-4a2d-a3c5-18658a99b8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd28a3ba13a49169970ab12d2e461e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.021959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:24.023467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.061380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 846/1749] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:23 2022] DELETE /identity/v3/users/cfd28a3ba13a49169970ab12d2e461e5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:24.067028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.067318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.067744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.131574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:24.133767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.270225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 847/1750] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:24.308016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 904/1751] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:24.328780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:24.330335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.485524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:24.487055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.518167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb57a6b-b875-44f8-8a64-2df488e3dfdd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:24.529708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f57d85-9c9c-42f2-8490-b4c943f6d071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:24.530462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57d85-9c9c-42f2-8490-b4c943f6d071 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.530837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57d85-9c9c-42f2-8490-b4c943f6d071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.531213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57d85-9c9c-42f2-8490-b4c943f6d071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.586159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f57d85-9c9c-42f2-8490-b4c943f6d071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.587856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f57d85-9c9c-42f2-8490-b4c943f6d071 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:24.615324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 848/1752] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:24.697363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b28632-3b43-44b7-914a-1f3955df91af None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:24.710709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:24.712224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.712714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.713132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.736489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.739405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:24.770503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 905/1753] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:25.197566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.198512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.199337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.294565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] MFA Rules not processed for user `a38be80ef1854cb3aeaa5ca40ed043f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:25.296543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:25.365239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:25.465355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 849/1754] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:25.492985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.494500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:25.528955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:25.677804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f9a41-b24e-4444-9314-2edc4f0de4c7 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.700265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d20c06-7869-4ea1-a346-c7edde5e7d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.701276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20c06-7869-4ea1-a346-c7edde5e7d4d service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.701491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20c06-7869-4ea1-a346-c7edde5e7d4d service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.701747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20c06-7869-4ea1-a346-c7edde5e7d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.734364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20c06-7869-4ea1-a346-c7edde5e7d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.738874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20c06-7869-4ea1-a346-c7edde5e7d4d service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.797939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 906/1755] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:27.226575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.228423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.297443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938bbb-b972-4a5c-b06d-27c8c9cec554 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.328336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.329176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.329463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.329747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] PATH_INFO: `/v3/projects/ee719164502347158ea5a7e7580cc76e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.332492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee719164502347158ea5a7e7580cc76e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.333902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.525703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee719164502347158ea5a7e7580cc76e', 'request_id': 'req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.564399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee719164502347158ea5a7e7580cc76e', 'request_id': 'req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.570735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee719164502347158ea5a7e7580cc76e', 'request_id': 'req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.594353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] The token cache is being invalidate because project ee719164502347158ea5a7e7580cc76e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:27.594567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.600537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120a4c5-0804-493e-9c58-a99a82aa3e50 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.601141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a6758df-8531-4a9f-9d57-35e3cec8e9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.601605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120a4c5-0804-493e-9c58-a99a82aa3e50 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.601886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120a4c5-0804-493e-9c58-a99a82aa3e50 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.603446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 907/1757] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:20:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:20:27.606344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 850/1757] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:27 2022] DELETE /identity/v3/projects/ee719164502347158ea5a7e7580cc76e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:27.608710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120a4c5-0804-493e-9c58-a99a82aa3e50 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.611406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d120a4c5-0804-493e-9c58-a99a82aa3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.795596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.796118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.796545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.849488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:27.850786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.973294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120a4c5-0804-493e-9c58-a99a82aa3e50 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.994782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.995717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.996154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.996590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] PATH_INFO: `/v3/users/4748408e98e646f1b648b3e4a4ac018e` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.999169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4748408e98e646f1b648b3e4a4ac018e)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.001362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.130501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 851/1758] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:28.188085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4748408e98e646f1b648b3e4a4ac018e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.202714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4748408e98e646f1b648b3e4a4ac018e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.206407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4748408e98e646f1b648b3e4a4ac018e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.207952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4748408e98e646f1b648b3e4a4ac018e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.224892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4748408e98e646f1b648b3e4a4ac018e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.281162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 908/1759] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:27 2022] DELETE /identity/v3/users/4748408e98e646f1b648b3e4a4ac018e => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:28.441158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:28.444238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.502033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392c21-3c67-4e51-9c27-6322f6c3b89c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:28.626600 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:28.687511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:28.688550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.690289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.690968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.702352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.734830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.737545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.770477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 852/1760] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:29.276719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:29.278379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:29.311093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:29.400645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:29.404882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:29.449427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32bf27-dc86-4c41-9e2f-b12aca0397be admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:29.470745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:29.473225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:29.473943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:29.474822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] PATH_INFO: `/v3/projects/1b3762fcdc144e10b3fef84bba375915` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:29.478242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3762fcdc144e10b3fef84bba375915)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:29.481584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:29.595639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3762fcdc144e10b3fef84bba375915', 'request_id': 'req-41c0859e-3075-4caf-8793-cf3cec6b601e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.616364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3762fcdc144e10b3fef84bba375915', 'request_id': 'req-41c0859e-3075-4caf-8793-cf3cec6b601e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.636888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3762fcdc144e10b3fef84bba375915', 'request_id': 'req-41c0859e-3075-4caf-8793-cf3cec6b601e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.691243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] The token cache is being invalidate because project 1b3762fcdc144e10b3fef84bba375915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:29.692999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.694434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.699162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 909/1761] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:29 2022] DELETE /identity/v3/projects/1b3762fcdc144e10b3fef84bba375915 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:29.703692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:29.706266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:29.726195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78dbb-1f3e-4ad2-9919-18d0dc28263a service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:29.962734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0859e-3075-4caf-8793-cf3cec6b601e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:29.992490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:29.993468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:29.993957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:29.994436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] PATH_INFO: `/v3/users/e455a4bec8e14789990c449322447e49` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:29.996061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e455a4bec8e14789990c449322447e49)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:30.000221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:30.055778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:30.058075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.058398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.058679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] PATH_INFO: `/v3/projects/66168ed4c826440a9abe6c5bb1edcc5a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.068300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66168ed4c826440a9abe6c5bb1edcc5a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:30.081760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:30.246728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:30.269083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e455a4bec8e14789990c449322447e49'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.350250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e455a4bec8e14789990c449322447e49'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.357510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e455a4bec8e14789990c449322447e49'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.367280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e455a4bec8e14789990c449322447e49'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.411278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8d2a440c-c4af-4950-89d3-10d700bc3cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e455a4bec8e14789990c449322447e49'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.478856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66168ed4c826440a9abe6c5bb1edcc5a', 'request_id': 'req-68db8914-c9ed-4149-b66c-88bfddd4a251'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.485622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 910/1762] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:29 2022] DELETE /identity/v3/users/e455a4bec8e14789990c449322447e49 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:30.495131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66168ed4c826440a9abe6c5bb1edcc5a', 'request_id': 'req-68db8914-c9ed-4149-b66c-88bfddd4a251'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.508980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66168ed4c826440a9abe6c5bb1edcc5a', 'request_id': 'req-68db8914-c9ed-4149-b66c-88bfddd4a251'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.547857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] The token cache is being invalidate because project 66168ed4c826440a9abe6c5bb1edcc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:30.548545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.549682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-68db8914-c9ed-4149-b66c-88bfddd4a251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.551611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 853/1763] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:29 2022] DELETE /identity/v3/projects/66168ed4c826440a9abe6c5bb1edcc5a => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:30.557353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.561044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.561384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.700116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:30.739371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:30.773129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc3dd-91aa-4203-b236-a1abb80ceb5d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.773691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc3dd-91aa-4203-b236-a1abb80ceb5d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.773901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc3dd-91aa-4203-b236-a1abb80ceb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.784014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:30.848078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-533dc3dd-91aa-4203-b236-a1abb80ceb5d None None] MFA Rules not processed for user `21b60f931d1948eb953e14ccee92da2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:30.849920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-533dc3dd-91aa-4203-b236-a1abb80ceb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.077561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 854/1764] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:31.098626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 911/1765] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:31.106498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.106784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.107260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.147632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:31.148910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.179931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 855/1766] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:31.189671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.206991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08fded-2f4c-47de-875c-f21b3af2b586 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.217747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.222419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.222721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.223001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.223705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:31.224014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.235081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.285517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 912/1767] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:31.286670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.307618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086719e-e73d-4775-a4d4-821801207dfe None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.312947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.313573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.313840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.314110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.320788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.322836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.327652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.329416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.353842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6386e2d-c01d-41ed-9e01-55e17b1984d6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.368354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.369040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.369316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.369583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] PATH_INFO: `/v3/projects/605f264327684f42a8d621ffc4071e74` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.372314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] RBAC: Authorizing `identity:delete_project(project_id=605f264327684f42a8d621ffc4071e74)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.374310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.402044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 856/1768] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:31.402044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.405770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.523803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605f264327684f42a8d621ffc4071e74', 'request_id': 'req-666e2372-765f-407a-90ec-8c28fbf6550b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:31.530356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605f264327684f42a8d621ffc4071e74', 'request_id': 'req-666e2372-765f-407a-90ec-8c28fbf6550b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:31.544733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56bc8f-5a2d-46e4-a156-659c23b0fb46 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.551133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605f264327684f42a8d621ffc4071e74', 'request_id': 'req-666e2372-765f-407a-90ec-8c28fbf6550b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:31.571521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] The token cache is being invalidate because project 605f264327684f42a8d621ffc4071e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:31.571824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:31.572613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:31.578026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 913/1769] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:31 2022] DELETE /identity/v3/projects/605f264327684f42a8d621ffc4071e74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:31.578946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.581599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.632539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:31.647651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:31.663291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.671896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.672320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.672725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.675666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.722590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e2372-765f-407a-90ec-8c28fbf6550b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.728504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65afc92-a351-49bd-824d-373200c73867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.729442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afc92-a351-49bd-824d-373200c73867 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.729994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afc92-a351-49bd-824d-373200c73867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.730284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65afc92-a351-49bd-824d-373200c73867 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.730996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65afc92-a351-49bd-824d-373200c73867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.733364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65afc92-a351-49bd-824d-373200c73867 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.771081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 914/1770] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:31.771081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a914a-3505-4487-ac64-39743b5c584b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.771081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a914a-3505-4487-ac64-39743b5c584b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.771081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a914a-3505-4487-ac64-39743b5c584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.801861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-607a914a-3505-4487-ac64-39743b5c584b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:31.803292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-607a914a-3505-4487-ac64-39743b5c584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.816484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 915/1771] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:31.827131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a914a-3505-4487-ac64-39743b5c584b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.843286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.844938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.847235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a914a-3505-4487-ac64-39743b5c584b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.853461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cddb1-d2a3-483b-89a8-0677c911eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.854613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cddb1-d2a3-483b-89a8-0677c911eb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.854893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cddb1-d2a3-483b-89a8-0677c911eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.855161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cddb1-d2a3-483b-89a8-0677c911eb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.855789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cddb1-d2a3-483b-89a8-0677c911eb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.859032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cddb1-d2a3-483b-89a8-0677c911eb7d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.875188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 916/1773] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:31.875375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 857/1773] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:31.875464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.875464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.875464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.876363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.899860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591b3c2-47dd-482e-b947-f4e9b952cbc3 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.918269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.919277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.919560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.919831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.920473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.926496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.932850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:31.934096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.962751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 858/1774] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:31.967571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 917/1775] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:31.973630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.974995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.008522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92403573-3f28-497e-8fd3-628c98396b40 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.013043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4edbd-7eda-4b31-be32-264637860b57 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.026773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.028691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede5a2d-8a34-496f-8dff-e5975b5acf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.029414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5a2d-8a34-496f-8dff-e5975b5acf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.029641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5a2d-8a34-496f-8dff-e5975b5acf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.029915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5a2d-8a34-496f-8dff-e5975b5acf5a admin admin] PATH_INFO: `/v3/projects/23fcfc5eb67c409b9e008e66a53ccc49/users/56352595e2424c2caa089717fd26ebdf/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.032816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.033108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.034085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.034826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:32.035094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.036760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.079696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 918/1776] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:32.089620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.090863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5a2d-8a34-496f-8dff-e5975b5acf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fcfc5eb67c409b9e008e66a53ccc49, user_id=56352595e2424c2caa089717fd26ebdf, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.109157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5a2d-8a34-496f-8dff-e5975b5acf5a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.134887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ca2a9-2f42-4163-89cf-038a2fd8d34f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.139391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 859/1777] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:31 2022] PUT /identity/v3/projects/23fcfc5eb67c409b9e008e66a53ccc49/users/56352595e2424c2caa089717fd26ebdf/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:32.153186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.153570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.153916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.226741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] MFA Rules not processed for user `56352595e2424c2caa089717fd26ebdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:32.230965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.325594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.327900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.333014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.334212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.335048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.340788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.424060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 860/1778] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:32.435743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.437353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.449302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 919/1779] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/projects => generated 381 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:32.450295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.625666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b82e0b-e73c-4c39-9f05-2566ec1fe689 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.637664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7c99-be4c-4a68-b07f-7f2e2662cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.638277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de990f-093c-44f0-973b-2ee60d2f386f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.638448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7c99-be4c-4a68-b07f-7f2e2662cc92 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.638570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7c99-be4c-4a68-b07f-7f2e2662cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.638815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7c99-be4c-4a68-b07f-7f2e2662cc92 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.639517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc7c99-be4c-4a68-b07f-7f2e2662cc92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.641502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc7c99-be4c-4a68-b07f-7f2e2662cc92 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.661549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:32.689612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:32.698519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 920/1780] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:32.699952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862107-d42e-4063-bae9-52cc1ce745ee None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.704134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862107-d42e-4063-bae9-52cc1ce745ee None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.704638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862107-d42e-4063-bae9-52cc1ce745ee None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.709293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 921/1781] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:20:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:32.710145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862107-d42e-4063-bae9-52cc1ce745ee None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.777386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862107-d42e-4063-bae9-52cc1ce745ee None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.795959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14c22b-35ce-4cfb-848c-a88bb0203604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.798700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14c22b-35ce-4cfb-848c-a88bb0203604 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.800622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14c22b-35ce-4cfb-848c-a88bb0203604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.800622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14c22b-35ce-4cfb-848c-a88bb0203604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.805446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14c22b-35ce-4cfb-848c-a88bb0203604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.816029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14c22b-35ce-4cfb-848c-a88bb0203604 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.848210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 922/1782] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:32.849498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeee56-d523-4bb8-a6a0-9b4bd92f7ee7 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.849781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeee56-d523-4bb8-a6a0-9b4bd92f7ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.850054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeee56-d523-4bb8-a6a0-9b4bd92f7ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.861104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.862285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.862564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.862823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.887394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-70aeee56-d523-4bb8-a6a0-9b4bd92f7ee7 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:32.894513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-70aeee56-d523-4bb8-a6a0-9b4bd92f7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.969585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.973136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.996593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 861/1783] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:32.997434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.011549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b646a-33f9-409c-be9f-8c1930329ed6 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.018416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.018992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.019473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.019793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.020483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.022418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.039271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 862/1784] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:33.044328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.058305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692a46f-dcae-4308-a1bf-ab3cc43f34c6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.070764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.072667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.072667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.072987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] PATH_INFO: `/v3/projects/deba2e3712954d98aa09c60c03442331/users/dc287d8d413c4e95921c8276d579bad0/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.089127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 923/1785] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:33.109274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] RBAC: Authorizing `identity:create_grant(project_id=deba2e3712954d98aa09c60c03442331, user_id=dc287d8d413c4e95921c8276d579bad0, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.116865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.164215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 863/1786] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:33 2022] PUT /identity/v3/projects/deba2e3712954d98aa09c60c03442331/users/dc287d8d413c4e95921c8276d579bad0/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:33.164470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d0de-b153-4096-8352-145e972396ed None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.164766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d0de-b153-4096-8352-145e972396ed None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.165039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d0de-b153-4096-8352-145e972396ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.225714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e358d0de-b153-4096-8352-145e972396ed None None] MFA Rules not processed for user `dc287d8d413c4e95921c8276d579bad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:33.228931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e358d0de-b153-4096-8352-145e972396ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.238610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.242926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.389429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 924/1787] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:33.394257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d0de-b153-4096-8352-145e972396ed None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.451006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3799f1-251d-4309-ba13-7cabb863152c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.468373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.469174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.469479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.469751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.497468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.500769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.520085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d0de-b153-4096-8352-145e972396ed None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.529279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.530237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.530819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.531483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.532862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.551623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 864/1788] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:33.551842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.553726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.568869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.582912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:33.606989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 925/1789] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:33.608275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.612003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ab8e-27f6-4e52-a9d8-8a65ff27b5b6 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.643629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:33.773789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37899196-105b-47a0-b03c-a58a4c9d1f29 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.785621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.793715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.794992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.796756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.798577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.803516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.806364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.807322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.807812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.809640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] PATH_INFO: `/v3/projects/2a5b7f7ec01348db9a6c1c51932eb35d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.813777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5b7f7ec01348db9a6c1c51932eb35d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.822085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.858123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 926/1790] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:33.863331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.887648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82041395-44d0-4f09-a664-542ba54b25f9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.911868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5b7f7ec01348db9a6c1c51932eb35d', 'request_id': 'req-52755099-4ae7-4341-b9aa-a0d28e50e618'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:33.929921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5b7f7ec01348db9a6c1c51932eb35d', 'request_id': 'req-52755099-4ae7-4341-b9aa-a0d28e50e618'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:33.948411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5b7f7ec01348db9a6c1c51932eb35d', 'request_id': 'req-52755099-4ae7-4341-b9aa-a0d28e50e618'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:33.991198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] The token cache is being invalidate because project 2a5b7f7ec01348db9a6c1c51932eb35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:33.991598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:33.993164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-52755099-4ae7-4341-b9aa-a0d28e50e618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:33.996263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 865/1791] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:33 2022] DELETE /identity/v3/projects/2a5b7f7ec01348db9a6c1c51932eb35d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.002294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3763-12eb-4e9c-8186-fe56f0c8fa99 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.003125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3763-12eb-4e9c-8186-fe56f0c8fa99 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.003400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3763-12eb-4e9c-8186-fe56f0c8fa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.034856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.035539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.035818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.036091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.036769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.042098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.059476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 927/1792] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.063570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.070112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.087446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-58ce3763-12eb-4e9c-8186-fe56f0c8fa99 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:34.090123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58ce3763-12eb-4e9c-8186-fe56f0c8fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.098008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3ed6-00c3-4a1e-b797-fbc08b0c5df7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.114659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.115341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.115729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.115864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] PATH_INFO: `/v3/projects/086c9d68aa9444d3bc04771704b206cb/users/bf5188834c4f450ab6a768377dde90c1/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.116216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 866/1793] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:34.124821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.125096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.125377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.155984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086c9d68aa9444d3bc04771704b206cb, user_id=bf5188834c4f450ab6a768377dde90c1, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.162270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.165688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:34.166932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.192901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 867/1794] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:34.193995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.205233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 928/1795] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:34 2022] PUT /identity/v3/projects/086c9d68aa9444d3bc04771704b206cb/users/bf5188834c4f450ab6a768377dde90c1/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.210871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.211926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117531-70dd-4ef5-9611-bcf7e4a3f5cb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.309587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.317274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a03a86-3f42-4613-9235-8708cb68eb72 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.336597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.336597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.336597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.336597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.337044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.337129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.337129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.337129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.337129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.337410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.337493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:34.337493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.337493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.348205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 929/1796] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.352165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.366375 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80328a-18af-43df-ab23-de710dd81706 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.367172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 868/1797] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:34.371723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.379148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e0acf-3984-4dff-bd49-6c3886a20afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.379906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e0acf-3984-4dff-bd49-6c3886a20afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.380187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e0acf-3984-4dff-bd49-6c3886a20afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.380463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e0acf-3984-4dff-bd49-6c3886a20afd admin admin] PATH_INFO: `/v3/projects/086c9d68aa9444d3bc04771704b206cb/users/bf5188834c4f450ab6a768377dde90c1/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.383260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e0acf-3984-4dff-bd49-6c3886a20afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=086c9d68aa9444d3bc04771704b206cb, user_id=bf5188834c4f450ab6a768377dde90c1, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.387688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e0acf-3984-4dff-bd49-6c3886a20afd admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.396926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6235d-81b7-4f38-9c2f-2bc30533e8fd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.408334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 930/1798] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:34 2022] PUT /identity/v3/projects/086c9d68aa9444d3bc04771704b206cb/users/bf5188834c4f450ab6a768377dde90c1/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.418245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.418692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.418970 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.445091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.514137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] MFA Rules not processed for user `bf5188834c4f450ab6a768377dde90c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:34.520372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.531136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.531858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.535867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.536183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.537484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.557693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.644753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 869/1799] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/projects => generated 399 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:34.649143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.704732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 931/1800] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:34.721253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.723157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.848889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd01e7-67e4-4d1b-b7ee-01cd9833b094 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.854965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.855591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.856238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.856907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.857564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.859508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.876818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352b44-863e-48a9-9c15-c3b3f7b152fb None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.895394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 870/1801] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:34.922763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.945334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f16c6-fd85-4d48-9b4a-a8836032463a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.954332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.954862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.955146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.956025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.956751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.958581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.984420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 871/1802] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.989268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.998385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fa050-875f-4c40-bc5b-b2d645521b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.999004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fa050-875f-4c40-bc5b-b2d645521b7f service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.999279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fa050-875f-4c40-bc5b-b2d645521b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.999545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fa050-875f-4c40-bc5b-b2d645521b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.003702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c6e7-db8c-424a-9b49-0e8c89def015 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.012356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.014995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.015383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.015673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.016948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.022174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.041380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 872/1803] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:35.042335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.076116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fe2b-71b7-4bca-a53c-b5340c15716a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.083663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:35.093165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229728b-3361-49e1-85bd-64e73179a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.094237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229728b-3361-49e1-85bd-64e73179a8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.094532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229728b-3361-49e1-85bd-64e73179a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.094825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229728b-3361-49e1-85bd-64e73179a8c3 admin admin] PATH_INFO: `/v3/projects/9803b041c2eb4b61ba09d00b9e34388b/users/71394c0e866a401e90451d619b1a6549/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.117525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229728b-3361-49e1-85bd-64e73179a8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9803b041c2eb4b61ba09d00b9e34388b, user_id=71394c0e866a401e90451d619b1a6549, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.121437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229728b-3361-49e1-85bd-64e73179a8c3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.151213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 873/1804] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:35 2022] PUT /identity/v3/projects/9803b041c2eb4b61ba09d00b9e34388b/users/71394c0e866a401e90451d619b1a6549/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:35.153121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.153413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.153689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.173591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fa050-875f-4c40-bc5b-b2d645521b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.176842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fa050-875f-4c40-bc5b-b2d645521b7f service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.221724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 932/1805] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:35.253529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] MFA Rules not processed for user `71394c0e866a401e90451d619b1a6549`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:35.264521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:35.383581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:35.386715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.386998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.387275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.438506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 874/1806] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:35.444156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] MFA Rules not processed for user `21b60f931d1948eb953e14ccee92da2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:35.445534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.449853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:35.591302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f4713-a81b-421f-8a7b-226b76079f44 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.598607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 933/1807] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:35.609876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.615516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.615516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.615516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.615516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.619416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.683076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 875/1808] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:35 2022] POST /identity/v3/projects => generated 397 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:35.687984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.704324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ce05-8895-4ca5-be95-dab6bc874fda None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.785498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b6fa-3c8c-4822-9b45-3ec4d4fe56e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.786204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b6fa-3c8c-4822-9b45-3ec4d4fe56e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.787015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b6fa-3c8c-4822-9b45-3ec4d4fe56e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.787015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b6fa-3c8c-4822-9b45-3ec4d4fe56e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.787724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b6fa-3c8c-4822-9b45-3ec4d4fe56e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.792649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b6fa-3c8c-4822-9b45-3ec4d4fe56e7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.839368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 934/1809] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:35 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:35.840250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.866070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.866344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.866624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.870706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881ac47-8f77-4826-a54d-ba4941e0a613 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.887958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.888583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.888874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.889144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.889888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.891621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.932006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 876/1810] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:35.935092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] MFA Rules not processed for user `a38be80ef1854cb3aeaa5ca40ed043f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:35.938238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.939108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:35.966948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ee29-500c-4861-8eb3-4a8a9ac8b8d9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.973855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.974787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.975217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.976685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] PATH_INFO: `/v3/projects/a41b18fdf6f2455faf13c62ad5243547/users/33f28b311cbf46b4a9d2832287e2db86/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.026422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b18fdf6f2455faf13c62ad5243547, user_id=33f28b311cbf46b4a9d2832287e2db86, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.035860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.042759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 935/1811] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:36.043663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.055831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f1c0-cb86-4a46-ba5a-3cb809d45429 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.062255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:36.062863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.063139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.063411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] PATH_INFO: `/v3/users/dc287d8d413c4e95921c8276d579bad0` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.065718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc287d8d413c4e95921c8276d579bad0)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.068119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.074477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:36.097320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 877/1812] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:35 2022] PUT /identity/v3/projects/a41b18fdf6f2455faf13c62ad5243547/users/33f28b311cbf46b4a9d2832287e2db86/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:36.098566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.164978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc287d8d413c4e95921c8276d579bad0'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:36.173126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc287d8d413c4e95921c8276d579bad0'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:36.173924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc287d8d413c4e95921c8276d579bad0'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:36.175187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc287d8d413c4e95921c8276d579bad0'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:36.187516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-80c2cf88-1db9-486f-8873-5a3c2708051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc287d8d413c4e95921c8276d579bad0'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:36.240696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 936/1813] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:36 2022] DELETE /identity/v3/users/dc287d8d413c4e95921c8276d579bad0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:36.243065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.243604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.244018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.301397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:36.303600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.311811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98240bce-6332-44d4-80b0-d32a88146e54 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.409693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:36.440388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:36.441376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.441814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.442227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.443011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.444805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.453528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 937/1814] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:36.464852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 878/1815] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:36.469254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.472869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.478766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.480678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.495790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a303-d39c-4782-afe2-c7518f571478 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.502662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931bdab-e696-48be-8781-2488893d0d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:36.503867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931bdab-e696-48be-8781-2488893d0d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.504290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931bdab-e696-48be-8781-2488893d0d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.504736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931bdab-e696-48be-8781-2488893d0d59 admin admin] PATH_INFO: `/v3/projects/a41b18fdf6f2455faf13c62ad5243547/users/33f28b311cbf46b4a9d2832287e2db86/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.507629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931bdab-e696-48be-8781-2488893d0d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b18fdf6f2455faf13c62ad5243547, user_id=33f28b311cbf46b4a9d2832287e2db86, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.511035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931bdab-e696-48be-8781-2488893d0d59 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.545309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 938/1816] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:36 2022] PUT /identity/v3/projects/a41b18fdf6f2455faf13c62ad5243547/users/33f28b311cbf46b4a9d2832287e2db86/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:36.547137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f219ec-831a-444d-af90-051e191ca3db None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.547536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f219ec-831a-444d-af90-051e191ca3db None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.547887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f219ec-831a-444d-af90-051e191ca3db None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.550138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 939/1817] 10.222.0.25 () {54 vars in 912 bytes} [Sun Aug 7 18:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:36.558210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78418ad5-5758-4336-8989-88bea89931aa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.563126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78418ad5-5758-4336-8989-88bea89931aa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.563688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78418ad5-5758-4336-8989-88bea89931aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.567224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042cc1e-ed4c-459c-b151-f69cce4a637c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.619811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-78418ad5-5758-4336-8989-88bea89931aa None None] MFA Rules not processed for user `33f28b311cbf46b4a9d2832287e2db86`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:36.621192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-78418ad5-5758-4336-8989-88bea89931aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.643270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:36.644522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.644677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.644909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.723341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:36.734357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 940/1818] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:36.735893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.736316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.737019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.747354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.752015 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.764048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 879/1819] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:36.764837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.766702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.770468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:36.772140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.801169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 941/1820] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:36.840203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:36.843286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.844727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:36.855381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07266d9-66d1-4274-ad83-78c92df85dba service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.857695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff8373-a313-4140-b43c-ef57fcb4081a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.862581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:36.863338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.863620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.863772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:36.863908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.864688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:36.865265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:36.865680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:36.874392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.875821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.881262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:36.883419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:36.887545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 880/1821] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:36.896275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 942/1822] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:36.983253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:36.993500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead919a-ccd6-40ee-8bf3-7386aa2232c7 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:36.999139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:37.000083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:37.000512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:37.001028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:37.003646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:37.078696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:37.081613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:37.091586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 881/1823] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:38.518746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:38.520396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:38.552663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41fc05-5e25-49c9-838b-ba8354b9f9e7 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:38.558592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:38.559310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:38.559647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:38.560128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] PATH_INFO: `/v3/projects/deba2e3712954d98aa09c60c03442331` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:38.561558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=deba2e3712954d98aa09c60c03442331)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:38.563903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:38.618470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deba2e3712954d98aa09c60c03442331', 'request_id': 'req-79cd9e7a-a2af-4809-ab63-76687fb12d5e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.624357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deba2e3712954d98aa09c60c03442331', 'request_id': 'req-79cd9e7a-a2af-4809-ab63-76687fb12d5e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.633709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deba2e3712954d98aa09c60c03442331', 'request_id': 'req-79cd9e7a-a2af-4809-ab63-76687fb12d5e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.645807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] The token cache is being invalidate because project deba2e3712954d98aa09c60c03442331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:38.646097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.646805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.648299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 943/1824] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:38 2022] DELETE /identity/v3/projects/deba2e3712954d98aa09c60c03442331 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:38.652209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:38.663715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a357d-a4da-48f4-8382-483364dd7e6d service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:38.726196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:38.726843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:38.727103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:38.727374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] PATH_INFO: `/v3/users/bf5188834c4f450ab6a768377dde90c1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:38.728518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5188834c4f450ab6a768377dde90c1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:38.730496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:38.804144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5188834c4f450ab6a768377dde90c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.817625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5188834c4f450ab6a768377dde90c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.818334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5188834c4f450ab6a768377dde90c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.819032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5188834c4f450ab6a768377dde90c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.833879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-39e3d32d-10eb-41e8-acea-baddad33683f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5188834c4f450ab6a768377dde90c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.867710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 882/1825] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:38 2022] DELETE /identity/v3/users/bf5188834c4f450ab6a768377dde90c1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:39.288877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.290431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.310513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9e7a-a2af-4809-ab63-76687fb12d5e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.372879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.373516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.373794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.374067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] PATH_INFO: `/v3/projects/086c9d68aa9444d3bc04771704b206cb` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.375199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086c9d68aa9444d3bc04771704b206cb)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.377402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.436714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086c9d68aa9444d3bc04771704b206cb', 'request_id': 'req-a63e8440-6c44-480e-b3a4-ae0992852550'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.445107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086c9d68aa9444d3bc04771704b206cb', 'request_id': 'req-a63e8440-6c44-480e-b3a4-ae0992852550'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.448641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:39.457762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086c9d68aa9444d3bc04771704b206cb', 'request_id': 'req-a63e8440-6c44-480e-b3a4-ae0992852550'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.487797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] The token cache is being invalidate because project 086c9d68aa9444d3bc04771704b206cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:39.488099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.489982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a63e8440-6c44-480e-b3a4-ae0992852550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.492869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 944/1826] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:39 2022] DELETE /identity/v3/projects/086c9d68aa9444d3bc04771704b206cb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:39.497370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.497784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.498132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.514876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:39.527883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:39.529876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.610750 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 883/1827] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:39.619135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.619651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.619738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.640483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:39.641804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.651024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 945/1828] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:39.655467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.667016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4a65-6139-4ecd-ae0f-192d0954acf1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.672671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.673598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.674732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.675183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.676039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:39.676530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.678316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.694237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 884/1829] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:39.696224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.706972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e23dfa-b522-4b7b-9f0f-1b2c03b2919e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.711606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.712213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.712492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.712796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.713432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.715389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.745949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 946/1830] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:39.749933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.761062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea33d-8558-4ee5-8a94-e58d421222bf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.822826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.823440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.823722 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.823993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.824655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.826561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.849596 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 885/1831] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:39.853768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.864337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eadcc8-1e24-4aef-b94b-095f03d7f73d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.869251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.869946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.870286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.870625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.871324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.873189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.883997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 947/1832] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:39.888613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.899755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b08c4-ffc7-4f63-9927-4cf12d866103 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.906903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103958-bd2a-4c5b-a805-44998e47a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.907756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103958-bd2a-4c5b-a805-44998e47a2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.908039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103958-bd2a-4c5b-a805-44998e47a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.909005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103958-bd2a-4c5b-a805-44998e47a2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.909661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08103958-bd2a-4c5b-a805-44998e47a2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.911261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08103958-bd2a-4c5b-a805-44998e47a2ae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.923040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 886/1833] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:39.927523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.943653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574762d-7711-4d3b-97ee-90b087d4f8f0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.955831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.956592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.957187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.957187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] PATH_INFO: `/v3/projects/02edb425cd6646da8190950db3e19eb1/users/591297634557435cad39f43e1d9953da/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.973897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02edb425cd6646da8190950db3e19eb1, user_id=591297634557435cad39f43e1d9953da, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.976762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.994124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 948/1834] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:39 2022] PUT /identity/v3/projects/02edb425cd6646da8190950db3e19eb1/users/591297634557435cad39f43e1d9953da/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:40.005509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.005818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.006090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.043255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] MFA Rules not processed for user `591297634557435cad39f43e1d9953da`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:40.044844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.124929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:40.133768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 887/1835] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:40.142029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.143933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.214660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39362a3-e5d9-4e3e-b6c5-fcb18fd431d7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.227022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad58fe-9d30-484c-9130-20d64e75b94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.227649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad58fe-9d30-484c-9130-20d64e75b94d service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.227924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad58fe-9d30-484c-9130-20d64e75b94d service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.228196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad58fe-9d30-484c-9130-20d64e75b94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.238660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad58fe-9d30-484c-9130-20d64e75b94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.240379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad58fe-9d30-484c-9130-20d64e75b94d service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.252618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 949/1836] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:40.286742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.401367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382c88-987a-42a5-9ae9-8f039306fade None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.406077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.406720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.407300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.407811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] PATH_INFO: `/v3/users/591297634557435cad39f43e1d9953da` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.409302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591297634557435cad39f43e1d9953da)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.411223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.487181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591297634557435cad39f43e1d9953da'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.495742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591297634557435cad39f43e1d9953da'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.496513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591297634557435cad39f43e1d9953da'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.497238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591297634557435cad39f43e1d9953da'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.507603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591297634557435cad39f43e1d9953da'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.534200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 888/1837] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:40 2022] DELETE /identity/v3/users/591297634557435cad39f43e1d9953da => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:40.539362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1403f-eac1-452d-bda1-a83fb3d73449 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.539654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1403f-eac1-452d-bda1-a83fb3d73449 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.539953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1403f-eac1-452d-bda1-a83fb3d73449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.565791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-30b1403f-eac1-452d-bda1-a83fb3d73449 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:40.567345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-30b1403f-eac1-452d-bda1-a83fb3d73449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.648697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 950/1838] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:40.655143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.656689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.728780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55b0e2-d0ef-46dc-938e-6b1d12d71b61 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.732420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f89902-2f55-486c-9756-97889f7ffe17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.733159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f89902-2f55-486c-9756-97889f7ffe17 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.733608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f89902-2f55-486c-9756-97889f7ffe17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.734064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f89902-2f55-486c-9756-97889f7ffe17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.744641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f89902-2f55-486c-9756-97889f7ffe17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.746088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f89902-2f55-486c-9756-97889f7ffe17 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.759243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 889/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:40.896304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649111-f36d-4f14-b1ce-18b1eeef0167 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.897179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649111-f36d-4f14-b1ce-18b1eeef0167 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.898462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649111-f36d-4f14-b1ce-18b1eeef0167 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.901116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 951/1840] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:20:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:40.909072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.909740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.911172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.958422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:40.962895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.013721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:41.122919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 890/1841] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:41.136593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1649111-f36d-4f14-b1ce-18b1eeef0167 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.138853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b1649111-f36d-4f14-b1ce-18b1eeef0167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.168486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1649111-f36d-4f14-b1ce-18b1eeef0167 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.175287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c58a63-d47e-4276-88bd-bf1b6b56d4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.175948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c58a63-d47e-4276-88bd-bf1b6b56d4b8 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.176821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c58a63-d47e-4276-88bd-bf1b6b56d4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.177299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c58a63-d47e-4276-88bd-bf1b6b56d4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.183333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.185638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.188244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c58a63-d47e-4276-88bd-bf1b6b56d4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.190598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c58a63-d47e-4276-88bd-bf1b6b56d4b8 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.205161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 952/1842] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:41.219585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074780-3baf-4eeb-8e8b-dd8c44ad2c35 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.230329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.231172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.231986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.237777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] PATH_INFO: `/v3/projects/02edb425cd6646da8190950db3e19eb1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.245004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=02edb425cd6646da8190950db3e19eb1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.247390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.364155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02edb425cd6646da8190950db3e19eb1', 'request_id': 'req-bdf18691-2513-46be-8666-360d5ab4d9fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.383451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02edb425cd6646da8190950db3e19eb1', 'request_id': 'req-bdf18691-2513-46be-8666-360d5ab4d9fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.395886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02edb425cd6646da8190950db3e19eb1', 'request_id': 'req-bdf18691-2513-46be-8666-360d5ab4d9fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.421230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] The token cache is being invalidate because project 02edb425cd6646da8190950db3e19eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:41.422456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.423192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bdf18691-2513-46be-8666-360d5ab4d9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.426594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 891/1843] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:41 2022] DELETE /identity/v3/projects/02edb425cd6646da8190950db3e19eb1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:41.431231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.431591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.431865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.469442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:41.470786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.495517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:41.587425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 953/1844] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:41.619038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.619742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.620214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.671277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:41.674761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.702834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 892/1845] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:41.706777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.725403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2311fce-af45-4486-8354-7c56e8ef2ffa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.739360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.741348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.741632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.741906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.742621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:41.747258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.749670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.790165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.790722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 954/1846] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:41.804173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f016e1-858b-4322-aab3-7d2462efec1b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.834510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.838283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.838579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.842571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.846657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.857123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.942366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 893/1847] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:41.947290 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.974518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14bda-29da-475f-8c0a-23cb843022c7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.123634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.124773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.125534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.126078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.127204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.129604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.162798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 955/1848] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:42.167859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.184121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bc4d4-0d45-4140-87e8-faf6f20149e4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.192151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.193115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.193551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.193982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.194855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.196688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.211758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.212380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 894/1849] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:42.214097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.216250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.234521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7ec90-04db-4aba-8426-a987d80846e9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.245216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27abf-38b8-49bf-a9b5-598de4756bb0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.251011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.251652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.251954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.252309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.253197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.255171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.256199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.256771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.257258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.258186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] PATH_INFO: `/v3/users/71394c0e866a401e90451d619b1a6549` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.261283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71394c0e866a401e90451d619b1a6549)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.267042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 895/1850] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:42.268052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.271853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.287818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed166ea-79f6-44e4-99db-ec5669a5db2a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.293276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8a159-f794-48a4-9598-be64028aebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.294200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8a159-f794-48a4-9598-be64028aebfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.294546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8a159-f794-48a4-9598-be64028aebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.295146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8a159-f794-48a4-9598-be64028aebfd admin admin] PATH_INFO: `/v3/projects/8917d98c95b246e5b95317a659f0d4c9/users/fdf6fc1eae2248d9a23a742b900d1b26/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.314590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8a159-f794-48a4-9598-be64028aebfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8917d98c95b246e5b95317a659f0d4c9, user_id=fdf6fc1eae2248d9a23a742b900d1b26, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.317642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8a159-f794-48a4-9598-be64028aebfd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.330701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71394c0e866a401e90451d619b1a6549'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.333383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 896/1851] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:42 2022] PUT /identity/v3/projects/8917d98c95b246e5b95317a659f0d4c9/users/fdf6fc1eae2248d9a23a742b900d1b26/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:42.338208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71394c0e866a401e90451d619b1a6549'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.338921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71394c0e866a401e90451d619b1a6549'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.339546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71394c0e866a401e90451d619b1a6549'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.343827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.344210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.344385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.350510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-aecfbc22-ba2e-4adf-8a73-134272961013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71394c0e866a401e90451d619b1a6549'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.371574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 956/1852] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:42 2022] DELETE /identity/v3/users/71394c0e866a401e90451d619b1a6549 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:42.376426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.376426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.376426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.379455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] MFA Rules not processed for user `fdf6fc1eae2248d9a23a742b900d1b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:42.381160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.385228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:42.393042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:42.402153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:42.403479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.466613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 897/1853] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:42.470813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.472259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.488986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 957/1854] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:42.501235 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.503541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.563124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c791d-2fcd-4f9c-9852-332d935f1fd1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.571938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.572664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.572984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.574626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.574626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.576136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.577507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb6bf0-6531-4de5-81a6-59302340d6af None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.582798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.583588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.583872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.584269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.606377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.608781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.614652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 898/1855] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:42 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:42.619007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.622581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 958/1856] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:42.751916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d03dc2-d216-4a4e-81d3-fee74cfeb46c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.769203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.769900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.770178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.770713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.771716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.773699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.815108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 899/1857] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:42 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:42.819207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.829576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4562c3f-a273-4999-96e4-03a1a67ca464 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.835810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.836426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.836737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.837191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.837746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.839872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.853691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 959/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:42.857384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.871019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331af9e-17ff-4093-b213-021d7b8a0eef admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.883667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6cb6-61af-46ed-8d15-6311d8a8c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.884601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6cb6-61af-46ed-8d15-6311d8a8c31c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.884601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6cb6-61af-46ed-8d15-6311d8a8c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.884864 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6cb6-61af-46ed-8d15-6311d8a8c31c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.885696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6cb6-61af-46ed-8d15-6311d8a8c31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.887133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6cb6-61af-46ed-8d15-6311d8a8c31c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.909769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 900/1859] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:42.913422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.926223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963e61-49bb-4e49-807d-10f11126010a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.932167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.932881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.933164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.933749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] PATH_INFO: `/v3/projects/7a8c0298bb894416978d564d124da846/users/390f23a51380407dab9515a715156c05/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.952337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8c0298bb894416978d564d124da846, user_id=390f23a51380407dab9515a715156c05, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.955789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.994831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 960/1860] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:42 2022] PUT /identity/v3/projects/7a8c0298bb894416978d564d124da846/users/390f23a51380407dab9515a715156c05/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:43.006096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.006672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.006980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.045023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] MFA Rules not processed for user `390f23a51380407dab9515a715156c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:43.051064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.057031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:43.075822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.084219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.168316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 901/1861] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:43.173176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.175751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c656d1-ba2c-416a-8e65-48095bf29fbc admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.181042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.181887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.182033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.182231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] PATH_INFO: `/v3/projects/9803b041c2eb4b61ba09d00b9e34388b` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.183444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9803b041c2eb4b61ba09d00b9e34388b)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.185462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.186077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50e36-35c2-49cf-b42b-4eafd6c93cc4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.195458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.196420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.196772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.197010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.197716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.199706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.206073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:43.231190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 902/1862] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:43.237954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.258004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9803b041c2eb4b61ba09d00b9e34388b', 'request_id': 'req-1c04ec9f-71e4-4304-bd44-d0073dc77484'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.265232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9803b041c2eb4b61ba09d00b9e34388b', 'request_id': 'req-1c04ec9f-71e4-4304-bd44-d0073dc77484'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.277014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9803b041c2eb4b61ba09d00b9e34388b', 'request_id': 'req-1c04ec9f-71e4-4304-bd44-d0073dc77484'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.296987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] The token cache is being invalidate because project 9803b041c2eb4b61ba09d00b9e34388b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:43.297379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.299336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.301944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 961/1863] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:43 2022] DELETE /identity/v3/projects/9803b041c2eb4b61ba09d00b9e34388b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:43.306031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.307474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.323316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247be7ce-ff6f-4e23-95cd-b79b0d0f4004 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.399959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.400469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.400780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.401054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.401700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.403856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.419233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04ec9f-71e4-4304-bd44-d0073dc77484 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.427370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.428095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.428352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.428924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] PATH_INFO: `/v3/users/33f28b311cbf46b4a9d2832287e2db86` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.430557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f28b311cbf46b4a9d2832287e2db86)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.434205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.449069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 903/1864] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:43.449069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.450332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.467389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b794be-c489-4a87-b0c5-3a825af2e6eb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.482034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.482933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.483371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.483708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.484402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.486232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.497639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 904/1865] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:43.502151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.507618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f28b311cbf46b4a9d2832287e2db86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.512756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792135b-0f8c-4309-b755-f55ce8397a18 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.515580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f28b311cbf46b4a9d2832287e2db86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.516272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f28b311cbf46b4a9d2832287e2db86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.516922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f28b311cbf46b4a9d2832287e2db86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.519529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.520578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.521115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.521388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] PATH_INFO: `/v3/projects/09be2e042f6c4ddc8bf6fa46c76f3051/users/05fcd37f50cf488da3a570e25d5d61f8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.525251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:43.529456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f28b311cbf46b4a9d2832287e2db86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.540694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09be2e042f6c4ddc8bf6fa46c76f3051, user_id=05fcd37f50cf488da3a570e25d5d61f8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.543277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.552018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 962/1866] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:43 2022] DELETE /identity/v3/users/33f28b311cbf46b4a9d2832287e2db86 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:43.560417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 905/1867] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:43 2022] PUT /identity/v3/projects/09be2e042f6c4ddc8bf6fa46c76f3051/users/05fcd37f50cf488da3a570e25d5d61f8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:43.564664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.566776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.597285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:43.646885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951db46-8084-4192-ae8c-4bb303697842 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.775413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a95eb-ef0f-4f8e-be5e-34859e6c7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.776135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a95eb-ef0f-4f8e-be5e-34859e6c7aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.776419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a95eb-ef0f-4f8e-be5e-34859e6c7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.776716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a95eb-ef0f-4f8e-be5e-34859e6c7aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.777365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a95eb-ef0f-4f8e-be5e-34859e6c7aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.779025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a95eb-ef0f-4f8e-be5e-34859e6c7aa9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.794024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 963/1868] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:43.798167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.809951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523396d-3b09-49a7-af55-2fd7a1931a6b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.814984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.815962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.816220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.816411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] PATH_INFO: `/v3/projects/09be2e042f6c4ddc8bf6fa46c76f3051/users/05fcd37f50cf488da3a570e25d5d61f8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.818326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09be2e042f6c4ddc8bf6fa46c76f3051, user_id=05fcd37f50cf488da3a570e25d5d61f8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.820969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.831535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 906/1869] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:43 2022] PUT /identity/v3/projects/09be2e042f6c4ddc8bf6fa46c76f3051/users/05fcd37f50cf488da3a570e25d5d61f8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:43.842775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.843328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.843439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.875596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] MFA Rules not processed for user `05fcd37f50cf488da3a570e25d5d61f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:43.877307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.959595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 964/1870] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:43.974809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.976548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.056083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d8e5-9840-42f9-8638-70acf92d25c9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.067060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.068365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.080919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.080919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.083870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.120065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.121538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.186054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.187793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.199062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 907/1871] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:44.199891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.201275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.203631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:44.222091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77059-1c49-4f57-ac7a-79d8be43b582 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.226998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.227983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.228069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.228297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] PATH_INFO: `/v3/users/56352595e2424c2caa089717fd26ebdf` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.229463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56352595e2424c2caa089717fd26ebdf)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.231392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.288991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bef68-1ad5-4e9e-89c3-563dd5946127 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.289421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56352595e2424c2caa089717fd26ebdf'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.293995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.294624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.294900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.295296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] PATH_INFO: `/v3/projects/a41b18fdf6f2455faf13c62ad5243547` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.297221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41b18fdf6f2455faf13c62ad5243547)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.297769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56352595e2424c2caa089717fd26ebdf'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.298683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56352595e2424c2caa089717fd26ebdf'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.299902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.300668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56352595e2424c2caa089717fd26ebdf'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.309599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-558bd5d1-2ae4-4f29-9856-b2280cfc7db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56352595e2424c2caa089717fd26ebdf'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.331659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 965/1872] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:44 2022] DELETE /identity/v3/users/56352595e2424c2caa089717fd26ebdf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:44.336415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.336754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.337034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.350636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:44.358899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:44.360329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.375686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41b18fdf6f2455faf13c62ad5243547', 'request_id': 'req-46d4ea61-8b3d-4005-ae2e-2592e8245c19'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.383840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41b18fdf6f2455faf13c62ad5243547', 'request_id': 'req-46d4ea61-8b3d-4005-ae2e-2592e8245c19'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.392962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41b18fdf6f2455faf13c62ad5243547', 'request_id': 'req-46d4ea61-8b3d-4005-ae2e-2592e8245c19'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.414301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] The token cache is being invalidate because project a41b18fdf6f2455faf13c62ad5243547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:44.414844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.415670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-46d4ea61-8b3d-4005-ae2e-2592e8245c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:44.417523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 908/1873] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:44 2022] DELETE /identity/v3/projects/a41b18fdf6f2455faf13c62ad5243547 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:44.422382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb4cc-ac4e-4788-b5ba-e6a5ee3fa27b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.422662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb4cc-ac4e-4788-b5ba-e6a5ee3fa27b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.422936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb4cc-ac4e-4788-b5ba-e6a5ee3fa27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.433590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 966/1874] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:44.444126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.445607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.449824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ca2eb4cc-ac4e-4788-b5ba-e6a5ee3fa27b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:44.451282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ca2eb4cc-ac4e-4788-b5ba-e6a5ee3fa27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.461398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 909/1875] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:44.474106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.474399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.474710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.512919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:44.516635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.529866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 910/1876] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:44.534502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.558340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b8b83-f07e-4ab3-a866-ed59b63db789 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.571913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.572732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.573017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.573292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.573896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636dc56-e9b0-45b9-9631-7963522fcc4f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.574212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:44.574728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.576884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.585586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.589984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.590375 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.590858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.593553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 911/1877] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:44.598416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.620020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.622006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.625721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dbd11-cb6b-468e-8172-1adc00c80989 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.645417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.646053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.646327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.646614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.647251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.650788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 967/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:44.651252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.690061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 912/1879] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:44 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:44.694473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.717112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbab71-c79b-43b0-8775-853118dc2828 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.734663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:44.870517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.871260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.871534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.871740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.873578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.878819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.934916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 968/1880] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:44 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:44.939726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.957237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79349f5-636f-462f-98f9-fa9ff8925fb2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.965143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.965869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.966304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.966582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.967830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.969788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.993651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 913/1881] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:44.995154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.011589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59ed9-a28b-4d41-b681-fc02e76e51f1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.017013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef729755-0e8e-4cbc-9bf2-c70750ab56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.018115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef729755-0e8e-4cbc-9bf2-c70750ab56bb admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.019132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef729755-0e8e-4cbc-9bf2-c70750ab56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.019418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef729755-0e8e-4cbc-9bf2-c70750ab56bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.020127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef729755-0e8e-4cbc-9bf2-c70750ab56bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.022019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef729755-0e8e-4cbc-9bf2-c70750ab56bb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.044515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 969/1882] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:45.045063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.060086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bac0f-4d61-478c-9c26-e116b4f47ab6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.069149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.070011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.070301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.070577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] PATH_INFO: `/v3/projects/fd1148b188194971a2dac98e9a257800/users/13d9379f6d4c4075af87edded146133e/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.107585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1148b188194971a2dac98e9a257800, user_id=13d9379f6d4c4075af87edded146133e, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.112804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.140894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 914/1883] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:45 2022] PUT /identity/v3/projects/fd1148b188194971a2dac98e9a257800/users/13d9379f6d4c4075af87edded146133e/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:45.145548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.146042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.146541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.199867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] MFA Rules not processed for user `13d9379f6d4c4075af87edded146133e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:45.202309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:45.319153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 970/1884] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:45.324371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.404107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4aee1-7aa7-4a2a-b61b-15b0bb8300a9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.412356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.413029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.413379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.413646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.414226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.416794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.453327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 915/1885] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:45 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:45.472863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.491564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed8fb-3d63-47c2-8b59-9719e1e99db0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.571618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.572332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.572818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.573187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.573964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.576252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.598367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.600129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:45.610641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 971/1886] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:45 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:45.617805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.621982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206d5b6-87a9-469d-9fa8-c2a24192ed41 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.633494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.634032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb95c6-6e73-4764-8044-87b40aa0c4a6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.634156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.634411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.634693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] PATH_INFO: `/v3/projects/23fcfc5eb67c409b9e008e66a53ccc49` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.638761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fcfc5eb67c409b9e008e66a53ccc49)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.640737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.645494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.653860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.654269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.654635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.655956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.658949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.671925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:45.688071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:45.689094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 972/1887] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:45.693488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.744265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6dd6-731a-4d11-a1ae-4aed5a304cc6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.751903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.752626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.752911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.753185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] PATH_INFO: `/v3/projects/b64df1ba7e9247eea38ca87e5c7da3a4/users/e278184577f846619c10bcf29dc58d03/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.799095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64df1ba7e9247eea38ca87e5c7da3a4, user_id=e278184577f846619c10bcf29dc58d03, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.802773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fcfc5eb67c409b9e008e66a53ccc49', 'request_id': 'req-85cc82d2-b478-4714-aa83-26299d0cf375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:45.810073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:45.812876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fcfc5eb67c409b9e008e66a53ccc49', 'request_id': 'req-85cc82d2-b478-4714-aa83-26299d0cf375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:45.824117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fcfc5eb67c409b9e008e66a53ccc49', 'request_id': 'req-85cc82d2-b478-4714-aa83-26299d0cf375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:45.839506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 973/1888] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:45 2022] PUT /identity/v3/projects/b64df1ba7e9247eea38ca87e5c7da3a4/users/e278184577f846619c10bcf29dc58d03/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:45.844482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:45.852270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] The token cache is being invalidate because project 23fcfc5eb67c409b9e008e66a53ccc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:45.852588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:45.853884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-85cc82d2-b478-4714-aa83-26299d0cf375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:45.857710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 916/1889] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:45 2022] DELETE /identity/v3/projects/23fcfc5eb67c409b9e008e66a53ccc49 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:45.863967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.864255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.865827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.917573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:45.922157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:45.968257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64188abc-43d1-483a-8a2c-39110a50f095 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:45.987462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:45.988527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:45.988854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:45.989135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:45.989803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:45.993958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:46.025409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 974/1890] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:46.025409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:46.026487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:46.048244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 917/1891] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:46.050152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:46.062015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765953e-f6a3-4cc8-bc86-631e963280b2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:46.064176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:46.079148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c5c4-1123-4c1c-afea-4271a391cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:46.080050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c5c4-1123-4c1c-afea-4271a391cc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.080458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c5c4-1123-4c1c-afea-4271a391cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.080833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c5c4-1123-4c1c-afea-4271a391cc04 admin admin] PATH_INFO: `/v3/projects/b64df1ba7e9247eea38ca87e5c7da3a4/users/e278184577f846619c10bcf29dc58d03/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.083341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3c5c4-1123-4c1c-afea-4271a391cc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64df1ba7e9247eea38ca87e5c7da3a4, user_id=e278184577f846619c10bcf29dc58d03, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:46.086965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3c5c4-1123-4c1c-afea-4271a391cc04 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:46.111000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 975/1892] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:46 2022] PUT /identity/v3/projects/b64df1ba7e9247eea38ca87e5c7da3a4/users/e278184577f846619c10bcf29dc58d03/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:46.111000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e364c3-6c39-4327-97e1-9beaa0a82f6d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.111000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e364c3-6c39-4327-97e1-9beaa0a82f6d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.111000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e364c3-6c39-4327-97e1-9beaa0a82f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.145527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21382165-5490-42b3-a2b3-e2e31e5a5723 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:46.170207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-53e364c3-6c39-4327-97e1-9beaa0a82f6d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:46.177479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-53e364c3-6c39-4327-97e1-9beaa0a82f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:46.209027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:46.209655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.209931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.210203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.212252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:46.254711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:46.346119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 976/1893] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:46.347812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212481c-e803-416a-adc9-a66bc410462d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.348094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212481c-e803-416a-adc9-a66bc410462d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.349125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212481c-e803-416a-adc9-a66bc410462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.381135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:46.383056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:46.404243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 918/1894] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:46.422949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:46.424332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a212481c-e803-416a-adc9-a66bc410462d None None] MFA Rules not processed for user `e278184577f846619c10bcf29dc58d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:46.425486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a212481c-e803-416a-adc9-a66bc410462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:46.497350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001149-97e1-45c9-9f80-c6c285f28887 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:46.517290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:46.517957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.518255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.518593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.519245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:46.519549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:46.521385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:46.537055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 919/1895] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:46.541727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:46.550938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:46.561507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada41d8-d147-4813-a9bf-799fb03240b3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:46.575092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:46.575949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.576904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.577179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.579125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:46.581086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:46.606958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 977/1896] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:46.649012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 920/1897] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:46 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:46.653278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212481c-e803-416a-adc9-a66bc410462d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:46.668593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212481c-e803-416a-adc9-a66bc410462d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:46.733456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:46.735416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:46.898802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:46.899530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.899881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.900369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.901117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:46.901546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5af54-30f8-43fa-8fdf-65112db14d34 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:46.904920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:46.913284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:46.914117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:46.914639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:46.915058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:46.975908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 978/1898] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:46 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:46.978752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.015117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.017152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.018694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304887-e78b-4e1d-87e4-57098c82e866 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.039182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.039943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.042522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.042698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 921/1899] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:47.043055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.043847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.047494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.083355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 979/1900] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:47.085749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.100872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e7b0-f5da-4bfc-be3f-40621e08598d service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.117284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab1ecd-4faf-45de-8a1d-5def8e59b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.117870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1ecd-4faf-45de-8a1d-5def8e59b1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.118191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1ecd-4faf-45de-8a1d-5def8e59b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.118462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1ecd-4faf-45de-8a1d-5def8e59b1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.119168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab1ecd-4faf-45de-8a1d-5def8e59b1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.120851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab1ecd-4faf-45de-8a1d-5def8e59b1c4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.150112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 922/1901] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:47.156757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.177099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f307-5e35-4348-92fa-18d38fa95776 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.191863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.197710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.198103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.198384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] PATH_INFO: `/v3/projects/a81f574a4cd44118a60524680f780070/users/23fa0e19ed934213ab83679f4b81576b/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.239882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81f574a4cd44118a60524680f780070, user_id=23fa0e19ed934213ab83679f4b81576b, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.248766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.283864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 980/1902] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:47 2022] PUT /identity/v3/projects/a81f574a4cd44118a60524680f780070/users/23fa0e19ed934213ab83679f4b81576b/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:47.286467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.286761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.287049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.320210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] MFA Rules not processed for user `23fa0e19ed934213ab83679f4b81576b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:47.321639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.327089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:47.375502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.430580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 923/1903] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:47.434951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.450976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7db5-8151-4cfb-af65-a42117c5fff1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.455594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.456169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.456442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.456748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.458644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.524646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3a61-ac08-4d73-8b59-576ba78ec6a6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.530581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.530778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.532740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.532740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.532740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.534691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.554592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:47.561210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.563116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.568253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 924/1904] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:47 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:47.573228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.576368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 981/1905] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:47.693005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2e500-8dd4-4f51-b9a9-c2b801f3e186 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.703152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.703785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.704064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.704339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.705003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.707064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.784340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 925/1906] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:47 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:47.785353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.808204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d258-a30e-49e9-a0d9-b962a9cce260 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.824272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.826969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.828708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.828936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.829689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.831137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.868276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 982/1907] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:47.869947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.889096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd8858-4592-400f-aed1-8d3bd33aba5c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.904914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.908801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.909431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.911303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] PATH_INFO: `/v3/projects/e086d68168d4499da0815b902979ce66/users/e18811ed34314e51ad157690a62426f7/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.971827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e086d68168d4499da0815b902979ce66, user_id=e18811ed34314e51ad157690a62426f7, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.975389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.979303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:47.994217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.996500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 926/1908] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:47 2022] PUT /identity/v3/projects/e086d68168d4499da0815b902979ce66/users/e18811ed34314e51ad157690a62426f7/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:47.997497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.072797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2c4ef-981d-4518-837c-20d7bae0beb0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.086318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.087974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.090019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.090504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.091298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.093229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.118432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 927/1909] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:48.120287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.144123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf493-c489-411e-a444-27834af6aa8d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.167454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e258aae-00ba-43c8-9e60-a4e05a10cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.167932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e258aae-00ba-43c8-9e60-a4e05a10cabe admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.168217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e258aae-00ba-43c8-9e60-a4e05a10cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.168490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e258aae-00ba-43c8-9e60-a4e05a10cabe admin admin] PATH_INFO: `/v3/projects/e086d68168d4499da0815b902979ce66/users/e18811ed34314e51ad157690a62426f7/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.170802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e258aae-00ba-43c8-9e60-a4e05a10cabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e086d68168d4499da0815b902979ce66, user_id=e18811ed34314e51ad157690a62426f7, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.173531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e258aae-00ba-43c8-9e60-a4e05a10cabe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.176214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bba1e-03d1-488e-93e4-9c2e009bf92b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.209354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 928/1910] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:48 2022] PUT /identity/v3/projects/e086d68168d4499da0815b902979ce66/users/e18811ed34314e51ad157690a62426f7/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:48.210266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.210657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.210943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.246120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] MFA Rules not processed for user `e18811ed34314e51ad157690a62426f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:48.247454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.370658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 929/1911] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:48.379710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.380722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.381210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.381657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.383103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.384057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.458633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5367cbd-9cbf-4c34-ab34-059acca53135 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.462806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.463510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.464887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.465200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.472155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.474636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.476479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.479356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.489063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 983/1912] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:48.495619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 930/1913] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:48.589462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.605536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc1c0-887e-4046-b5ac-019e6599f731 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.611837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139038-4a2f-4f7e-99b4-abfab39d60f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.613319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139038-4a2f-4f7e-99b4-abfab39d60f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.614232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139038-4a2f-4f7e-99b4-abfab39d60f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.614575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139038-4a2f-4f7e-99b4-abfab39d60f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.672974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:48.685639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139038-4a2f-4f7e-99b4-abfab39d60f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.686856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139038-4a2f-4f7e-99b4-abfab39d60f0 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.699704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 984/1914] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:52.610740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:52.612745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:52.622332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:52.680525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de33c81-0f97-4660-a580-42525c0377f5 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:52.685145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:52.685780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:52.686062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:52.686367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] PATH_INFO: `/v3/users/fdf6fc1eae2248d9a23a742b900d1b26` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:52.687488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf6fc1eae2248d9a23a742b900d1b26)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:52.690124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:52.751154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf6fc1eae2248d9a23a742b900d1b26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:52.761436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf6fc1eae2248d9a23a742b900d1b26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:52.762157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf6fc1eae2248d9a23a742b900d1b26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:52.762769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf6fc1eae2248d9a23a742b900d1b26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:52.770814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf6fc1eae2248d9a23a742b900d1b26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:52.789639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 931/1915] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:52 2022] DELETE /identity/v3/users/fdf6fc1eae2248d9a23a742b900d1b26 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:52.801358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:52.801358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:52.801358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:52.815018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:52.816252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:52.884160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 985/1916] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:52.894740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:52.896155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:52.982050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee9804-e071-4187-ba93-806df4c3a8fe admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:52.988704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a26f1-1369-41d6-81ef-eef860024602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:52.989704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a26f1-1369-41d6-81ef-eef860024602 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:52.996165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a26f1-1369-41d6-81ef-eef860024602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:52.996165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a26f1-1369-41d6-81ef-eef860024602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:53.002835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a26f1-1369-41d6-81ef-eef860024602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:53.004502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a26f1-1369-41d6-81ef-eef860024602 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:53.019172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 932/1917] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:53.108122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:53.109645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:53.123659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02ebe-b7d1-4e44-b642-34ca538caca7 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:53.132411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:53.132946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:53.133299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:53.133669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] PATH_INFO: `/v3/users/13d9379f6d4c4075af87edded146133e` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:53.135403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d9379f6d4c4075af87edded146133e)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:53.138476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:53.219047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d9379f6d4c4075af87edded146133e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:53.229939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d9379f6d4c4075af87edded146133e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:53.231120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d9379f6d4c4075af87edded146133e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:53.231496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d9379f6d4c4075af87edded146133e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:53.246676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d9379f6d4c4075af87edded146133e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:53.306279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 986/1918] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:53 2022] DELETE /identity/v3/users/13d9379f6d4c4075af87edded146133e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:53.310718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:53.311004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:53.311273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:53.341732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:53.343097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:53.391791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:53.437992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 933/1919] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:53.449139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:53.450687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:53.543325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7cca5-82cc-4c44-8c30-07583fe27f9a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:53.548447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:53.549867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:53.550259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:53.550940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:53.563327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:53.565303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:53.579449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 987/1920] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:53.948288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:53.950293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:53.962726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56807fa2-a928-4563-b866-ae09e868eb18 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:53.969574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:53.970434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:53.971077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:53.971473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] PATH_INFO: `/v3/projects/8917d98c95b246e5b95317a659f0d4c9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:53.972680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8917d98c95b246e5b95317a659f0d4c9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:53.974639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.002411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.004471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.014416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:54.020871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc5732-9de6-4394-b0c6-40cb23bb67e4 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:54.039610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8917d98c95b246e5b95317a659f0d4c9', 'request_id': 'req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.047008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8917d98c95b246e5b95317a659f0d4c9', 'request_id': 'req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.061048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8917d98c95b246e5b95317a659f0d4c9', 'request_id': 'req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.076707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] The token cache is being invalidate because project 8917d98c95b246e5b95317a659f0d4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:54.076992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.077665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.079183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 934/1921] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:53 2022] DELETE /identity/v3/projects/8917d98c95b246e5b95317a659f0d4c9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:54.083615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.085697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.090418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:54.091502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.092167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.092665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] PATH_INFO: `/v3/users/c87cc6ed568b41499475d9b8a6eea663` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.094695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87cc6ed568b41499475d9b8a6eea663)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:54.098012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.099708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f614-28ce-4af0-a82c-0de8d8ef8a3d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:54.105043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:54.105688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.106073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.106358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] PATH_INFO: `/v3/users/390f23a51380407dab9515a715156c05` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.109889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] RBAC: Authorizing `identity:delete_user(user_id=390f23a51380407dab9515a715156c05)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:54.112867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.164099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87cc6ed568b41499475d9b8a6eea663'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.171883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87cc6ed568b41499475d9b8a6eea663'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.172552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87cc6ed568b41499475d9b8a6eea663'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.173215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87cc6ed568b41499475d9b8a6eea663'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.178333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390f23a51380407dab9515a715156c05'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.183289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87cc6ed568b41499475d9b8a6eea663'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.187124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390f23a51380407dab9515a715156c05'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.188717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390f23a51380407dab9515a715156c05'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.190098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390f23a51380407dab9515a715156c05'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.201417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5e688693-f10e-4ec9-805c-f8164268977e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390f23a51380407dab9515a715156c05'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.203227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 988/1922] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/users/c87cc6ed568b41499475d9b8a6eea663 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:54.204189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.205929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.224887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 935/1923] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/users/390f23a51380407dab9515a715156c05 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:54.226561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a854e-bbda-4901-9716-cf891339c037 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.227061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a854e-bbda-4901-9716-cf891339c037 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.227344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a854e-bbda-4901-9716-cf891339c037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.247334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-995a854e-bbda-4901-9716-cf891339c037 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:54.248477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-995a854e-bbda-4901-9716-cf891339c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.270788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:54.318521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5179ad-76a5-4b9c-a725-6208c4f2b2f8 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:54.335217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 936/1924] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:54.350730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a854e-bbda-4901-9716-cf891339c037 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.352454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-995a854e-bbda-4901-9716-cf891339c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.354252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:54.396885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:54.397598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.397803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.398079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] PATH_INFO: `/v3/projects/fd1148b188194971a2dac98e9a257800` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.399358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1148b188194971a2dac98e9a257800)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:54.401590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.462751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a854e-bbda-4901-9716-cf891339c037 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:54.468108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:54.469209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.469547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.470204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.482305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:54.483972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.487191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1148b188194971a2dac98e9a257800', 'request_id': 'req-39201365-cf3d-485c-820f-9893209c0287'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.495551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1148b188194971a2dac98e9a257800', 'request_id': 'req-39201365-cf3d-485c-820f-9893209c0287'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.496158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 937/1925] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:54.504372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1148b188194971a2dac98e9a257800', 'request_id': 'req-39201365-cf3d-485c-820f-9893209c0287'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.518199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] The token cache is being invalidate because project fd1148b188194971a2dac98e9a257800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:54.518495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.519228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.523776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 989/1926] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/projects/fd1148b188194971a2dac98e9a257800 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:54.525022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.526496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.541045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9ea2-55b0-4096-ab19-a4feb53b592f service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:54.620050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:54.620894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.621234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.621579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] PATH_INFO: `/v3/users/e278184577f846619c10bcf29dc58d03` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.622904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e278184577f846619c10bcf29dc58d03)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:54.625139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.641992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.643796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.685106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39201365-cf3d-485c-820f-9893209c0287 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:54.693946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:54.694937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:54.695606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:54.695896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] PATH_INFO: `/v3/projects/7a8c0298bb894416978d564d124da846` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:54.697966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8c0298bb894416978d564d124da846)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:54.700410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:54.720495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e278184577f846619c10bcf29dc58d03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.756866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e278184577f846619c10bcf29dc58d03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.757573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e278184577f846619c10bcf29dc58d03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.758326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e278184577f846619c10bcf29dc58d03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.771605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e278184577f846619c10bcf29dc58d03'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.778343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:54.811265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 938/1927] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/users/e278184577f846619c10bcf29dc58d03 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:54.815440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8c0298bb894416978d564d124da846', 'request_id': 'req-d3af9174-4881-4784-8746-54bcf727d7ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.822589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8c0298bb894416978d564d124da846', 'request_id': 'req-d3af9174-4881-4784-8746-54bcf727d7ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.833898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8c0298bb894416978d564d124da846', 'request_id': 'req-d3af9174-4881-4784-8746-54bcf727d7ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.847092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] The token cache is being invalidate because project 7a8c0298bb894416978d564d124da846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:54.847528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.848320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:54.856045 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 990/1928] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/projects/7a8c0298bb894416978d564d124da846 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:54.863503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.868141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:54.996127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:54.998633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.017962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b2c7-73b4-47ae-8ff5-707609a9eec6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.025885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.026781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.028873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.029253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] PATH_INFO: `/v3/users/05fcd37f50cf488da3a570e25d5d61f8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.034410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fcd37f50cf488da3a570e25d5d61f8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.042960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:55.075545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:55.094308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9174-4881-4784-8746-54bcf727d7ef admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.114749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.116066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.116348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.116698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] PATH_INFO: `/v3/projects/0b75cf1cd421471ca06440476e7becb6` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.117936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b75cf1cd421471ca06440476e7becb6)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.131040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:55.161123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fcd37f50cf488da3a570e25d5d61f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.172059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fcd37f50cf488da3a570e25d5d61f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.173373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fcd37f50cf488da3a570e25d5d61f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.174899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fcd37f50cf488da3a570e25d5d61f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.188664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fcd37f50cf488da3a570e25d5d61f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.220530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 939/1929] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/users/05fcd37f50cf488da3a570e25d5d61f8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:55.232139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b75cf1cd421471ca06440476e7becb6', 'request_id': 'req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.240145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b75cf1cd421471ca06440476e7becb6', 'request_id': 'req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.250524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b75cf1cd421471ca06440476e7becb6', 'request_id': 'req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.265374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] The token cache is being invalidate because project 0b75cf1cd421471ca06440476e7becb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:55.266119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.267316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.270289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 991/1930] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:54 2022] DELETE /identity/v3/projects/0b75cf1cd421471ca06440476e7becb6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:55.274129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:55.275626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.333712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:55.335118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.363856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade3fd8-cb32-4267-ae07-a54331b1815c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.369364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.370659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.371003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.371289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] PATH_INFO: `/v3/users/d4ea54e5cdb94b208b77558f43be9452` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.372608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ea54e5cdb94b208b77558f43be9452)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.374790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:55.382167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:55.427670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa1b5-d241-47c6-805c-dc35532d9ad5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.443738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ea54e5cdb94b208b77558f43be9452'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.444749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.445414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.445648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.445919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] PATH_INFO: `/v3/projects/b64df1ba7e9247eea38ca87e5c7da3a4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.447134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64df1ba7e9247eea38ca87e5c7da3a4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.449391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:55.457190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ea54e5cdb94b208b77558f43be9452'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.458315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ea54e5cdb94b208b77558f43be9452'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.459443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ea54e5cdb94b208b77558f43be9452'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.469685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b4426f8c-9602-45b9-ab58-ac617c14633c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ea54e5cdb94b208b77558f43be9452'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.504193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 940/1931] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:55 2022] DELETE /identity/v3/users/d4ea54e5cdb94b208b77558f43be9452 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:55.512419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64df1ba7e9247eea38ca87e5c7da3a4', 'request_id': 'req-f68c7ed2-62e6-402c-915d-1db0a62ec10c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.519887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64df1ba7e9247eea38ca87e5c7da3a4', 'request_id': 'req-f68c7ed2-62e6-402c-915d-1db0a62ec10c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.530372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64df1ba7e9247eea38ca87e5c7da3a4', 'request_id': 'req-f68c7ed2-62e6-402c-915d-1db0a62ec10c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.546832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] The token cache is being invalidate because project b64df1ba7e9247eea38ca87e5c7da3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:55.546832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.546832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.548769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 992/1932] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:55 2022] DELETE /identity/v3/projects/b64df1ba7e9247eea38ca87e5c7da3a4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:55.552192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ce12-3fe3-417e-ab68-7bcf83b4555e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.552476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ce12-3fe3-417e-ab68-7bcf83b4555e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.552815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ce12-3fe3-417e-ab68-7bcf83b4555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.575254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c053ce12-3fe3-417e-ab68-7bcf83b4555e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:55.576595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c053ce12-3fe3-417e-ab68-7bcf83b4555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.584105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:55.588301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.594146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:55.652373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 941/1933] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:55.661441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.661963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.662214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.684149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:55.685404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.694954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 942/1934] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:55.699071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:55.702826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c7ed2-62e6-402c-915d-1db0a62ec10c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.709883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2cd9-0374-4e23-8e9e-77ad4a21dda3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.710414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.711354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.712900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.713184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] PATH_INFO: `/v3/projects/09be2e042f6c4ddc8bf6fa46c76f3051` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.714714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09be2e042f6c4ddc8bf6fa46c76f3051)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.716206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.716820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:55.717778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.718059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.718330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.720038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:55.720342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.722673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:55.764688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 943/1935] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:55.767160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:55.797191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f7bc-6c58-4ede-b1a4-d796efd69f66 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:55.804524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09be2e042f6c4ddc8bf6fa46c76f3051', 'request_id': 'req-a9890b15-fb9a-4d2c-89c3-b873f0a72607'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.838067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09be2e042f6c4ddc8bf6fa46c76f3051', 'request_id': 'req-a9890b15-fb9a-4d2c-89c3-b873f0a72607'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.866038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09be2e042f6c4ddc8bf6fa46c76f3051', 'request_id': 'req-a9890b15-fb9a-4d2c-89c3-b873f0a72607'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.905358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] The token cache is being invalidate because project 09be2e042f6c4ddc8bf6fa46c76f3051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:55.905660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.910633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a9890b15-fb9a-4d2c-89c3-b873f0a72607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:55.916542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 993/1936] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:55 2022] DELETE /identity/v3/projects/09be2e042f6c4ddc8bf6fa46c76f3051 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:55.922055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.922476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.924610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.977554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:55.978887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:55.988776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:55.989391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:55.989754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:55.989980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:55.990678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:55.993527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.016304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:56.053225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 944/1937] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:55 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:56.053878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.055656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.060987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 994/1938] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:56.062041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.063344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.080629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f03b-c69d-4cb5-a551-94adca1675e7 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.122947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:56.146098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e86d-5e58-4bb5-b5d6-7ecc075302b7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.150712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb3c6f-6023-43e6-80fa-7dd456629a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.151317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3c6f-6023-43e6-80fa-7dd456629a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.151419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.151595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3c6f-6023-43e6-80fa-7dd456629a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.151866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3c6f-6023-43e6-80fa-7dd456629a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.151956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.152212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.152484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] PATH_INFO: `/v3/projects/80b4a722f34a4f779f97f160bd457be5` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.152595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb3c6f-6023-43e6-80fa-7dd456629a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.153639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b4a722f34a4f779f97f160bd457be5)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.154444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb3c6f-6023-43e6-80fa-7dd456629a17 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.155523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.181423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 945/1939] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:56.181423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.181423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.181423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.201102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:56.202329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.214671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b4a722f34a4f779f97f160bd457be5', 'request_id': 'req-df469139-e748-485a-8b7c-4fecc962751f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.227024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b4a722f34a4f779f97f160bd457be5', 'request_id': 'req-df469139-e748-485a-8b7c-4fecc962751f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.240977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b4a722f34a4f779f97f160bd457be5', 'request_id': 'req-df469139-e748-485a-8b7c-4fecc962751f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.258920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] The token cache is being invalidate because project 80b4a722f34a4f779f97f160bd457be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:56.259253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.259931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.265212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 995/1940] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:56 2022] DELETE /identity/v3/projects/80b4a722f34a4f779f97f160bd457be5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:56.265212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.265212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.277138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 946/1941] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:56.278576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.279498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.294142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7260d39-63d4-433d-91d4-bf0913d37721 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.300276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e79dd-ec7b-4f96-8ab0-71d7e75a698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.300931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e79dd-ec7b-4f96-8ab0-71d7e75a698c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.301267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e79dd-ec7b-4f96-8ab0-71d7e75a698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.301625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e79dd-ec7b-4f96-8ab0-71d7e75a698c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.302305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e79dd-ec7b-4f96-8ab0-71d7e75a698c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.304301 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e79dd-ec7b-4f96-8ab0-71d7e75a698c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.322220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 947/1942] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:56.323941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.324232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.324507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.348286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:56.349557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.352320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df469139-e748-485a-8b7c-4fecc962751f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.357412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.358078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 948/1943] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:56.358469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.358924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.359172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.359628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] PATH_INFO: `/v3/users/23fa0e19ed934213ab83679f4b81576b` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.361661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fa0e19ed934213ab83679f4b81576b)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.364333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.371329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30910ef-114d-4f5e-bab0-11080bb8f676 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.375970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.377346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.378277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.378277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.378618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:56.378917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.380512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.393789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 949/1944] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:56.394814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.410265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a77111-afe6-4c09-b64e-6b9ce8beec68 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.415982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe166-9354-4350-b249-3399564d64f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.416715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe166-9354-4350-b249-3399564d64f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.416998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe166-9354-4350-b249-3399564d64f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.417274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe166-9354-4350-b249-3399564d64f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.417927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe166-9354-4350-b249-3399564d64f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.419700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe166-9354-4350-b249-3399564d64f6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.423414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fa0e19ed934213ab83679f4b81576b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.433691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fa0e19ed934213ab83679f4b81576b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.435254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fa0e19ed934213ab83679f4b81576b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.435435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 950/1945] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:56.436256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fa0e19ed934213ab83679f4b81576b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.436899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.437190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.437464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.449066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fa0e19ed934213ab83679f4b81576b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:56.458218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:56.475996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:56.477578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.494028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 996/1946] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:56 2022] DELETE /identity/v3/users/23fa0e19ed934213ab83679f4b81576b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:56.494028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.496016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.502555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 951/1947] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:56.504102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.506454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.544935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacd057-a5a9-49bd-91d3-5b7654260907 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.582671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:56.610831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d1217-edb7-41af-8eae-b4e37e07a695 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.619975 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b5bea-7023-43eb-bbe9-5be3ff6e6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.621107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5bea-7023-43eb-bbe9-5be3ff6e6e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.621505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5bea-7023-43eb-bbe9-5be3ff6e6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.622164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5bea-7023-43eb-bbe9-5be3ff6e6e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.622962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b5bea-7023-43eb-bbe9-5be3ff6e6e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.625882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b5bea-7023-43eb-bbe9-5be3ff6e6e64 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.630264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.631001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.631339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.631651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] PATH_INFO: `/v3/projects/72ba876db05943228b927b75cda0e845/users/3011a280fa9b4bdeb8cd15c33bfbbc6f/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.648215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ba876db05943228b927b75cda0e845, user_id=3011a280fa9b4bdeb8cd15c33bfbbc6f, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.651526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.660615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 997/1948] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:56.660615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.660615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.660615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.670833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 952/1949] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:56 2022] PUT /identity/v3/projects/72ba876db05943228b927b75cda0e845/users/3011a280fa9b4bdeb8cd15c33bfbbc6f/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:56.671669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.687054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:56.688305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.758706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6d90-6e0f-4057-b21a-33358a766853 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.766478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.767105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.767962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.768285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.769850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:56.770110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.771746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554f79-9383-433f-bfa5-928a608a072c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.775376 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 998/1950] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:56.775376 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.791983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957ff8-d961-4a12-a394-b03d9127de94 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.796350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.797208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.797614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.797992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.799147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.803434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 953/1951] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:56.803585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.813155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.813451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.813751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.844988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 999/1952] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:56.844988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.844988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.867758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] MFA Rules not processed for user `3011a280fa9b4bdeb8cd15c33bfbbc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:56.869847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:56.942100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add6c7-8e8f-44cc-b10b-5aac8ae90df2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:56.946915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:56.948007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:56.948378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:56.948724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:56.956479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:56.962407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:56.964792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:56.986904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1000/1953] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:56.988040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:56.999537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 954/1954] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:57.000411 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.002506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68d6e0-7878-4be8-a7b3-b38780640d01 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.010539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.011293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.011757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.012087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.012818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.015647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.032970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dd518-f11f-4378-84cc-cb08309a1d77 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.050313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.051595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.052390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.052390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.053354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.055780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.066894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1001/1955] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:56 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:57.066894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.078130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 955/1956] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:57.082255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.107312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d118782-1eb8-4d83-a9c7-a2643d0e22ca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.141903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:57.188881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.190304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.190681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.191168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.191905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.195111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.227140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 956/1957] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:57 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:57.227140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.230167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeaafd-d22c-4832-9ef0-5364303b5349 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.240753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c8c3d-21ca-42c6-8eec-84b8cd4181e0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.244138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.244818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.245133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.245613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.246291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.247299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.247922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.248331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.248436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.248694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.249345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.253035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.270543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 957/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:57.274129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.288362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f5b5-2b61-4461-aec5-4c9e10505774 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.295846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.296875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.297421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.297741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.299145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.302472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.308218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1002/1959] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:57 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:57.312095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.316317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 958/1960] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:57.317515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.332178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fabad-bd4b-4bca-b4f7-9a9ba1e1d73b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.418827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf2216-2cc0-4294-b8e0-3c9b1d42f18f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.426863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.427553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.427836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.428101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] PATH_INFO: `/v3/projects/e71e8e13080644198758cf0085780c48/users/0ea25f4c603748d9a3c16e23c8c97d0d/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.446144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71e8e13080644198758cf0085780c48, user_id=0ea25f4c603748d9a3c16e23c8c97d0d, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.449082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.468019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1003/1961] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:57 2022] PUT /identity/v3/projects/e71e8e13080644198758cf0085780c48/users/0ea25f4c603748d9a3c16e23c8c97d0d/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:57.470976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.498182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf49e3-2193-4d7b-a6fd-93bbc8f98bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.498806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf49e3-2193-4d7b-a6fd-93bbc8f98bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.499085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf49e3-2193-4d7b-a6fd-93bbc8f98bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.499373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf49e3-2193-4d7b-a6fd-93bbc8f98bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.500498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf49e3-2193-4d7b-a6fd-93bbc8f98bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.502571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf49e3-2193-4d7b-a6fd-93bbc8f98bd9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.539369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 959/1962] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:57 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:57.540110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:57.540585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012537a-241d-49fa-801c-555badc722e7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.540885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012537a-241d-49fa-801c-555badc722e7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.542077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012537a-241d-49fa-801c-555badc722e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.565178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5a5d-d8aa-4c50-8bd2-1ab37c6a0f74 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.570605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.571639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.572108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.572589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.573421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.575250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.587619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1004/1963] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:57.588928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.589592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e012537a-241d-49fa-801c-555badc722e7 None None] MFA Rules not processed for user `0ea25f4c603748d9a3c16e23c8c97d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:57.590886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e012537a-241d-49fa-801c-555badc722e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:57.603361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edd56c-d9a5-4dba-9fde-628fc37d33c3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.618662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.619282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.620442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.620836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.624401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.626142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.648428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1005/1964] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:57.651828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.673311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2880586-5bf0-4745-b830-81c25c24a091 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.684178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 960/1965] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:57.686370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012537a-241d-49fa-801c-555badc722e7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.693215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e012537a-241d-49fa-801c-555badc722e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:57.709071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012537a-241d-49fa-801c-555badc722e7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.711238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.711908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.712185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.712455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] PATH_INFO: `/v3/projects/7303e86295594eea95be7da4625fbb56/users/3afa5d3c98a54beabe95530e0536e9b2/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.727377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.728268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.728408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.728672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] PATH_INFO: `/v3/projects/a81f574a4cd44118a60524680f780070` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.729809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81f574a4cd44118a60524680f780070)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.731782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.738484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7303e86295594eea95be7da4625fbb56, user_id=3afa5d3c98a54beabe95530e0536e9b2, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:57.741735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:57.748392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:57.764243 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1006/1966] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:57 2022] PUT /identity/v3/projects/7303e86295594eea95be7da4625fbb56/users/3afa5d3c98a54beabe95530e0536e9b2/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:57.765315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.822567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81f574a4cd44118a60524680f780070', 'request_id': 'req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:57.831804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81f574a4cd44118a60524680f780070', 'request_id': 'req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:57.843549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81f574a4cd44118a60524680f780070', 'request_id': 'req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:57.863550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] The token cache is being invalidate because project a81f574a4cd44118a60524680f780070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:57.863872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:57.864645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:57.866310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0107-9c90-4087-8bfe-e29dc97322d6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.869692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 961/1967] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:57 2022] DELETE /identity/v3/projects/a81f574a4cd44118a60524680f780070 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:57.870894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:57.873095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:57.965452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9920-a3c1-44c2-ad32-02ed17d7782b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:57.970059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:57.970864 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:57.971138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:57.971404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:57.973599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.013994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd978a6-9f33-4aeb-befc-ca36c5fce1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.014936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd978a6-9f33-4aeb-befc-ca36c5fce1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.016613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd978a6-9f33-4aeb-befc-ca36c5fce1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.016613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd978a6-9f33-4aeb-befc-ca36c5fce1e0 admin admin] PATH_INFO: `/v3/projects/e8adca1d662145eead31cdf1bec3dd5f/users/a97d331709694116b3baf32fc4fb04f3/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.039688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd978a6-9f33-4aeb-befc-ca36c5fce1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8adca1d662145eead31cdf1bec3dd5f, user_id=a97d331709694116b3baf32fc4fb04f3, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.042048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd978a6-9f33-4aeb-befc-ca36c5fce1e0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.049838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.051290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.057508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1007/1968] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:57 2022] PUT /identity/v3/projects/e8adca1d662145eead31cdf1bec3dd5f/users/a97d331709694116b3baf32fc4fb04f3/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:58.058513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.058863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.059071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.061215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 962/1969] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:58.063613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.065337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.085041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ccc8e-e4e7-4588-af81-141bc1fdaaaa service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.092910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] MFA Rules not processed for user `3afa5d3c98a54beabe95530e0536e9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:58.094175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.119017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:58.149532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:58.162643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.163281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.163568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.163826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] PATH_INFO: `/v3/users/e18811ed34314e51ad157690a62426f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.165006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18811ed34314e51ad157690a62426f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.167127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.171283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1008/1970] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:58.172126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.174448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.189633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75c6d-9e10-4fe4-8d0e-e5cc5a91a48c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.194575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.195523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.195769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.196102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.196926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.198800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.211342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1009/1971] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:58.212354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.214324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.230843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b93af-3405-409b-92da-75079eb00472 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.234100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18811ed34314e51ad157690a62426f7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:58.236799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.237449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.237728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.238052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.238921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.241078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.245317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18811ed34314e51ad157690a62426f7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:58.246141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18811ed34314e51ad157690a62426f7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:58.247029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18811ed34314e51ad157690a62426f7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:58.258032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18811ed34314e51ad157690a62426f7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:58.276107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1010/1972] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:58 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:58.276957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.279453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.283340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 963/1973] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:58 2022] DELETE /identity/v3/users/e18811ed34314e51ad157690a62426f7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:58.284370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.285911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.376322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b9bb-cc99-47df-b6c1-90b42f58f868 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.388860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585a1d-c2ff-4249-ab98-1dfdd8b3e837 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.389872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.390863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.391380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.391798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.392855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.396351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416ea0-3520-4671-ba1e-1a2436065f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.397063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416ea0-3520-4671-ba1e-1a2436065f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.397333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416ea0-3520-4671-ba1e-1a2436065f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.397604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416ea0-3520-4671-ba1e-1a2436065f51 admin admin] PATH_INFO: `/v3/projects/e8adca1d662145eead31cdf1bec3dd5f/users/a97d331709694116b3baf32fc4fb04f3/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.399669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416ea0-3520-4671-ba1e-1a2436065f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8adca1d662145eead31cdf1bec3dd5f, user_id=a97d331709694116b3baf32fc4fb04f3, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.402747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416ea0-3520-4671-ba1e-1a2436065f51 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.406921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.415122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1011/1974] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:58 2022] PUT /identity/v3/projects/e8adca1d662145eead31cdf1bec3dd5f/users/a97d331709694116b3baf32fc4fb04f3/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:58.427877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.428283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.428768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.450489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 964/1975] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:58 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:58.453529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.469052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] MFA Rules not processed for user `a97d331709694116b3baf32fc4fb04f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:58.470508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.489334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c4d3f-bb1d-4ebb-b503-6af532618fca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.617276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1012/1976] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:58.622462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.623710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.624039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.624389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.625295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.627951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.629990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.631309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:58.631422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.651945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 965/1977] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:58.655633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:58.664412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.683569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b584c6-0c67-4f8a-9fdc-e985c013309d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.690734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.691607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.692150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.692633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] PATH_INFO: `/v3/projects/d47e61a7f98c4f14ad86fd639963b68d/users/1a491d648d1a479285eef395e51dfc8a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.713594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47e61a7f98c4f14ad86fd639963b68d, user_id=1a491d648d1a479285eef395e51dfc8a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.729169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.737206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc6d3-084d-4a10-8dde-0d8afae4e841 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.746615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.748438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.748893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.750393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.757662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 966/1978] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:58 2022] PUT /identity/v3/projects/d47e61a7f98c4f14ad86fd639963b68d/users/1a491d648d1a479285eef395e51dfc8a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:58.762086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.776639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.778342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.812791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1013/1979] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:58.828400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.830785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:58.847252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154e5f-97d2-4cd0-b487-b6a8acd7bcf0 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.880796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90a90-a8ca-4156-823d-d8f19b5a44d9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:58.900922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.903039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.903220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.904202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.906177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.909647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:58.936308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 967/1980] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:58.937571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:58.969963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:58.970798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:58.971287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:58.971578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] PATH_INFO: `/v3/projects/e086d68168d4499da0815b902979ce66` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:58.972855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e086d68168d4499da0815b902979ce66)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:58.974786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.018753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391557-25be-4087-84b6-9d21af5743e7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.022529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.023315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.023438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.023673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.025764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.063402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e086d68168d4499da0815b902979ce66', 'request_id': 'req-b137a18b-b94b-49d3-8440-225be275f311'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.072300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e086d68168d4499da0815b902979ce66', 'request_id': 'req-b137a18b-b94b-49d3-8440-225be275f311'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.102369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e086d68168d4499da0815b902979ce66', 'request_id': 'req-b137a18b-b94b-49d3-8440-225be275f311'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.106777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.108538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a0ab6-6c5c-48eb-a56a-fd3a668f5e7d service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.124649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] The token cache is being invalidate because project e086d68168d4499da0815b902979ce66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:59.125247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.126096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.128724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1014/1981] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:58 2022] DELETE /identity/v3/projects/e086d68168d4499da0815b902979ce66 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:59.132039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:59.132157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 968/1982] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:59.132254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.149306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16773d92-54ce-4ddc-8f94-340f05311b20 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.149847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16773d92-54ce-4ddc-8f94-340f05311b20 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.150130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16773d92-54ce-4ddc-8f94-340f05311b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.187187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-16773d92-54ce-4ddc-8f94-340f05311b20 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:59.188701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-16773d92-54ce-4ddc-8f94-340f05311b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.237644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:59.244994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:59.291447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137a18b-b94b-49d3-8440-225be275f311 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.321259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ab8df-b61a-4daa-bd5d-5ffeac20d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.321963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ab8df-b61a-4daa-bd5d-5ffeac20d05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.322222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ab8df-b61a-4daa-bd5d-5ffeac20d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.322532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ab8df-b61a-4daa-bd5d-5ffeac20d05c admin admin] PATH_INFO: `/v3/projects/d47e61a7f98c4f14ad86fd639963b68d/users/1a491d648d1a479285eef395e51dfc8a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.325899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ab8df-b61a-4daa-bd5d-5ffeac20d05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47e61a7f98c4f14ad86fd639963b68d, user_id=1a491d648d1a479285eef395e51dfc8a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.328752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ab8df-b61a-4daa-bd5d-5ffeac20d05c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.356952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1015/1983] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:59 2022] PUT /identity/v3/projects/d47e61a7f98c4f14ad86fd639963b68d/users/1a491d648d1a479285eef395e51dfc8a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:59.365055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.365470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.365833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.366657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 969/1984] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:59.375686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.375686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.375992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.400148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:59.401815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.443531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] MFA Rules not processed for user `1a491d648d1a479285eef395e51dfc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:59.444990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.529281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 970/1985] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:59.530467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:59.540676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089056-c145-448a-a22b-8c68a03c19b9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.545933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.546249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.546604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.546952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.547703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:59.548108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.550774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.563580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1016/1986] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:59.565454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 971/1987] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:59.573623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:59.589386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:59.589386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.601750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9936f90-8d76-4b26-93e5-8cc171b84fbc None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.618381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.619013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.619299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.619557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.620187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.622129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.657107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1017/1988] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:59 2022] POST /identity/v3/projects => generated 355 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:59.658943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:59.660947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.694100 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff2d3-169b-40d7-a94c-4903f2485e6b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.744973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080af87-076a-4746-a044-2839963ebebb admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.749869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.750500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.750818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.751183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] PATH_INFO: `/v3/users/3011a280fa9b4bdeb8cd15c33bfbbc6f` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.752730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3011a280fa9b4bdeb8cd15c33bfbbc6f)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.753378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.753994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.754265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.754534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.754982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.778852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:59.806635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:59.810105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3011a280fa9b4bdeb8cd15c33bfbbc6f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.821787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3011a280fa9b4bdeb8cd15c33bfbbc6f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.822895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3011a280fa9b4bdeb8cd15c33bfbbc6f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.823506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3011a280fa9b4bdeb8cd15c33bfbbc6f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.837619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-33bd4db4-a2ab-495a-b867-7ec0fb55e6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3011a280fa9b4bdeb8cd15c33bfbbc6f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:59.846854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.848672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.866216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 972/1989] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:59.866369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1018/1990] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:59 2022] DELETE /identity/v3/users/3011a280fa9b4bdeb8cd15c33bfbbc6f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:59.866453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:59.870273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.870632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.870978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.880313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea12e1-205a-4f9f-9dba-8b146b93c92f service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:59.895963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:59.897702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:59.990059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:59.990792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:59.991170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:59.991538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:59.992366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:59.994487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:59.997358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1019/1991] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:00.011309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.013336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:00.038803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 973/1992] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:59 2022] POST /identity/v3/users => generated 278 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:00.047956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.047956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:00.061284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b66ee9-dacb-4a58-a68e-39df8e062e0b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.066919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.067655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.068065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.068543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.069330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.071095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.087703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 974/1993] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:00.089582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.112616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4bc5-bcef-409b-b6a7-7ea8ec41451f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.128076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743020f5-64fa-4162-ac9e-52fcab1ce633 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.130489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9262f0-517b-45de-ae9d-7423a1408cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.131359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9262f0-517b-45de-ae9d-7423a1408cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.132225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.132752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9262f0-517b-45de-ae9d-7423a1408cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.132909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.133229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.133628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.134772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9262f0-517b-45de-ae9d-7423a1408cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.139105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9262f0-517b-45de-ae9d-7423a1408cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.141051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9262f0-517b-45de-ae9d-7423a1408cc0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.147603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.149572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.162779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1020/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:00.170222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 975/1995] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:00.179829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.206955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166754e-852c-4eb8-b30d-9c79f4e1a59c service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.219441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.220298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.221744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.222101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] PATH_INFO: `/v3/projects/8a0f78f6928945c6b97ec36ac8fc4346/users/06732a8b66f441809edef62be6424815/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.268985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0f78f6928945c6b97ec36ac8fc4346, user_id=06732a8b66f441809edef62be6424815, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.276087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.308287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1021/1996] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:00 2022] PUT /identity/v3/projects/8a0f78f6928945c6b97ec36ac8fc4346/users/06732a8b66f441809edef62be6424815/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:00.339655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.340445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.340916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.396811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] MFA Rules not processed for user `06732a8b66f441809edef62be6424815`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:00.398752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:00.522969 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 976/1997] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:00.524953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.575312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:00.610516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffba148-bf6a-4ca1-b786-8f40db090609 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.615954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.616524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.616838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.617171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.617736 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.619775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.658364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1022/1998] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:00 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:00.662958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.675133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e284d0-e23d-4660-af6b-4113b3f56db3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.684254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.686597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:00.692525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:00.753926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.754832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.755289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.755664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.756390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.758488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.803512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 977/1999] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:00 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:00.804469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.816781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68769-1baf-400e-bd0e-9ea729659f07 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.816911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141e612-ac83-4f56-a1d5-cb5733fb85b1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.823228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.823950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.824312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.824737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.825508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.827017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.827577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.828261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.828862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.829275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] PATH_INFO: `/v3/projects/72ba876db05943228b927b75cda0e845` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.831318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ba876db05943228b927b75cda0e845)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.833468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.840421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 978/2000] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:00.844238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.860778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476934-8e01-4447-80d3-48d8b68ca1fc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:00.866833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:00.867503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:00.867780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:00.868051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] PATH_INFO: `/v3/projects/183cfcaf5938427e98be50220b444461/users/e0df8fc3772a45b4bc31e64725da8e0e/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:00.894866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183cfcaf5938427e98be50220b444461, user_id=e0df8fc3772a45b4bc31e64725da8e0e, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:00.897343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:00.904330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ba876db05943228b927b75cda0e845', 'request_id': 'req-ea96e78e-bac1-4170-a5d6-9a64d087960f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:00.915745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ba876db05943228b927b75cda0e845', 'request_id': 'req-ea96e78e-bac1-4170-a5d6-9a64d087960f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:00.916825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 979/2001] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:00 2022] PUT /identity/v3/projects/183cfcaf5938427e98be50220b444461/users/e0df8fc3772a45b4bc31e64725da8e0e/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:00.920703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.932391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ba876db05943228b927b75cda0e845', 'request_id': 'req-ea96e78e-bac1-4170-a5d6-9a64d087960f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:00.947292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] The token cache is being invalidate because project 72ba876db05943228b927b75cda0e845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:00.947800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:00.948808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:00.952004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1023/2002] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:00 2022] DELETE /identity/v3/projects/72ba876db05943228b927b75cda0e845 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:00.957582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:00.959655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.017586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80f54a-618b-428f-ac96-be7b8007f7f9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:01.022635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:01.023238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.023509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.023619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:01.023779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.024415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:01.026139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:01.040925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 980/2003] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:01.041438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e78e-bac1-4170-a5d6-9a64d087960f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:01.042557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:01.044549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.050350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:01.057433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.057433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.057433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] PATH_INFO: `/v3/users/a97d331709694116b3baf32fc4fb04f3` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.057433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97d331709694116b3baf32fc4fb04f3)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:01.057433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:01.059035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a62b-231d-46b1-ab6b-163bebf6dad1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:01.065290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9894a-b1ff-45b0-b5d6-95377bf99946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:01.065916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9894a-b1ff-45b0-b5d6-95377bf99946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.066190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9894a-b1ff-45b0-b5d6-95377bf99946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.066458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9894a-b1ff-45b0-b5d6-95377bf99946 admin admin] PATH_INFO: `/v3/projects/183cfcaf5938427e98be50220b444461/users/e0df8fc3772a45b4bc31e64725da8e0e/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.068440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9894a-b1ff-45b0-b5d6-95377bf99946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183cfcaf5938427e98be50220b444461, user_id=e0df8fc3772a45b4bc31e64725da8e0e, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:01.072183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9894a-b1ff-45b0-b5d6-95377bf99946 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:01.091688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 981/2004] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:01 2022] PUT /identity/v3/projects/183cfcaf5938427e98be50220b444461/users/e0df8fc3772a45b4bc31e64725da8e0e/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:01.104286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.104816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.111971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.113437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97d331709694116b3baf32fc4fb04f3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.123530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97d331709694116b3baf32fc4fb04f3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.124280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97d331709694116b3baf32fc4fb04f3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.124912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97d331709694116b3baf32fc4fb04f3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.134372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97d331709694116b3baf32fc4fb04f3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.143771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] MFA Rules not processed for user `e0df8fc3772a45b4bc31e64725da8e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:01.145172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.155241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1024/2005] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:00 2022] DELETE /identity/v3/users/a97d331709694116b3baf32fc4fb04f3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:01.199272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:01.235023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 982/2006] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:01.248964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:01.250615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.353019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64621f76-81af-4a93-b376-ebf31815c15b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:01.358065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:01.358755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.359444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.359781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.466497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:01.472328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:01.520792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1025/2007] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:01.598538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:01.600070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.678632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:01.680177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.700095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a7517-043d-4f3b-85ea-abb6ef714844 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:01.716795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:01.719221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.719652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.722525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.727227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:01.740577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34f74-d750-45bb-8eb2-f8dbb85adebb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:01.759801 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:01.833634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:01.834278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:01.834613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:01.834893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] PATH_INFO: `/v3/projects/e8adca1d662145eead31cdf1bec3dd5f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:01.836432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8adca1d662145eead31cdf1bec3dd5f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:01.841125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:01.845462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:01.847450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7b8e9-d1e7-42b2-b0ef-7da708dc728d service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:01.861874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1026/2008] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:01.958727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8adca1d662145eead31cdf1bec3dd5f', 'request_id': 'req-78fc60bb-96f2-4097-9269-4c0f99e85306'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.969398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8adca1d662145eead31cdf1bec3dd5f', 'request_id': 'req-78fc60bb-96f2-4097-9269-4c0f99e85306'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:01.980074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8adca1d662145eead31cdf1bec3dd5f', 'request_id': 'req-78fc60bb-96f2-4097-9269-4c0f99e85306'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.000282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] The token cache is being invalidate because project e8adca1d662145eead31cdf1bec3dd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:02.000605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.001322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-78fc60bb-96f2-4097-9269-4c0f99e85306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.004996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 983/2009] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:01 2022] DELETE /identity/v3/projects/e8adca1d662145eead31cdf1bec3dd5f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:02.011496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.012042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.012392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.042156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:02.044669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.166322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1027/2010] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:02.174231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.174818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.174818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.195591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:02.196840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.206423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 984/2011] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:02.210579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.216431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.217906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.221501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e51104-9566-4df9-b741-10bb1345a657 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.226415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.227019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.227298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.227573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.228223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:02.228526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.230146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.231412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ec361-04da-4a8c-a7ce-3e2ade01094c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.236447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.237055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.237341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.237607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] PATH_INFO: `/v3/users/3afa5d3c98a54beabe95530e0536e9b2` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.238726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afa5d3c98a54beabe95530e0536e9b2)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.240671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.242221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1028/2012] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:02.245652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:02.246763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.259154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605059a6-e127-43d6-ad68-97907e3269f5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.264609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.265205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.265483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.266132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.267729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.270597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.293725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afa5d3c98a54beabe95530e0536e9b2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.299049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1029/2013] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:02.301199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afa5d3c98a54beabe95530e0536e9b2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.301840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afa5d3c98a54beabe95530e0536e9b2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.302462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afa5d3c98a54beabe95530e0536e9b2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.303841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.305498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.309581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b658fed3-694c-4563-a751-25377805aa88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afa5d3c98a54beabe95530e0536e9b2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:02.327691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 985/2014] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:02 2022] DELETE /identity/v3/users/3afa5d3c98a54beabe95530e0536e9b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:02.332628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.333098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.333538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.352820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:02.354054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.375043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26a65-7550-4520-90a4-773a104040da admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.404544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:02.414185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 986/2015] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:02.423924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.426069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.435371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.436111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.436399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.436705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.437327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.439572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.462656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1030/2016] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:02.466764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.477574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a29c2-f5dc-4d27-92ba-8116a48a28b4 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.482148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.482732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.483041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.483311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.483940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.485571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.488363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b4cd-7ef0-4a95-9b1e-17a82f2babb0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.496936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.497109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1031/2017] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:02.497680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.498062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.498383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.501077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.510499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.511522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27816dd9-5cf7-492e-a80d-d30d533e4929 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.512361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.517802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd4842-a884-4248-847f-f21feed5a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.518480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4842-a884-4248-847f-f21feed5a1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.518758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4842-a884-4248-847f-f21feed5a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.519030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4842-a884-4248-847f-f21feed5a1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.519671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd4842-a884-4248-847f-f21feed5a1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.521466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd4842-a884-4248-847f-f21feed5a1e8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.524251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 987/2018] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:02.533750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1032/2019] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:02.538014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.547770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8c78-166a-40b3-bf42-73c3e16c65be service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.552923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.553572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.553851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.554126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] PATH_INFO: `/v3/projects/9010455b4e0d4caca90627bc66c55819/users/0e7a9872bd6a40d381920c2a21510d5f/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.569878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9010455b4e0d4caca90627bc66c55819, user_id=0e7a9872bd6a40d381920c2a21510d5f, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.572390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.582031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:02.587626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 988/2020] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:02 2022] PUT /identity/v3/projects/9010455b4e0d4caca90627bc66c55819/users/0e7a9872bd6a40d381920c2a21510d5f/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:02.599013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.599706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.600399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.634782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] MFA Rules not processed for user `0e7a9872bd6a40d381920c2a21510d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:02.636021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:02.728612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1033/2021] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:02.729448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.850120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733499a-3cfa-4bec-bf86-cc09e5f36140 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.862003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:02.862647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:02.863013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:02.863429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:02.864489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:02.866501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:02.903089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 989/2022] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:02.904224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.932182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db21ce3-4e9d-4cac-82af-25c6f8520ca2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:02.939592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:02.941415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:03.027470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c17d-1747-4499-9115-84b83c88c84e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.034193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.034957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.035240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.035685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] PATH_INFO: `/v3/projects/7303e86295594eea95be7da4625fbb56` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.037950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7303e86295594eea95be7da4625fbb56)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.041081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.052519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.053402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.053773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.054047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.054924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.057078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.091178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1034/2023] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:02 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:03.095911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.109745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397658-cd72-49a3-973d-49aed2e24688 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.114224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7303e86295594eea95be7da4625fbb56', 'request_id': 'req-cca42e16-7347-469b-9ddf-402b81cc79c3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.128413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7303e86295594eea95be7da4625fbb56', 'request_id': 'req-cca42e16-7347-469b-9ddf-402b81cc79c3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.133803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:03.139598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7303e86295594eea95be7da4625fbb56', 'request_id': 'req-cca42e16-7347-469b-9ddf-402b81cc79c3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.161170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] The token cache is being invalidate because project 7303e86295594eea95be7da4625fbb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:03.162006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.163419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.165571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 990/2024] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:02 2022] DELETE /identity/v3/projects/7303e86295594eea95be7da4625fbb56 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:03.169577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.171136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:03.230119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:03.252836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.253518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.253860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.254128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.254784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.259800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.286989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1035/2025] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:03.289098 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.292057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:03.311185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276b0ee-f7d4-48d1-b888-afe2bebe1952 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.333234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.335663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.336028 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.336808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.338250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.364142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.364512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca42e16-7347-469b-9ddf-402b81cc79c3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.375879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.376830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.377251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.377578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] PATH_INFO: `/v3/users/1a491d648d1a479285eef395e51dfc8a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.379646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a491d648d1a479285eef395e51dfc8a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.383933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.396518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1036/2026] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:03.400519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.416845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581f40-a70e-47a6-8509-f7254b3f7fa0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.429593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083415d-31a8-4848-ad8d-94df625b7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.431929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083415d-31a8-4848-ad8d-94df625b7388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.432400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083415d-31a8-4848-ad8d-94df625b7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.432750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083415d-31a8-4848-ad8d-94df625b7388 admin admin] PATH_INFO: `/v3/projects/e04f7c88ec16433d8c8937feec9878a6/users/cf8c22086077473abddf02aec8ae29a3/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.477581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083415d-31a8-4848-ad8d-94df625b7388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04f7c88ec16433d8c8937feec9878a6, user_id=cf8c22086077473abddf02aec8ae29a3, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.480431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083415d-31a8-4848-ad8d-94df625b7388 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.484635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a491d648d1a479285eef395e51dfc8a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.499433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a491d648d1a479285eef395e51dfc8a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.499953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1037/2027] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:03 2022] PUT /identity/v3/projects/e04f7c88ec16433d8c8937feec9878a6/users/cf8c22086077473abddf02aec8ae29a3/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:03.503908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a491d648d1a479285eef395e51dfc8a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.504780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a491d648d1a479285eef395e51dfc8a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.511189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.511466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.511735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.522636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a491d648d1a479285eef395e51dfc8a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:03.558486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 991/2028] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:03 2022] DELETE /identity/v3/users/1a491d648d1a479285eef395e51dfc8a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:03.563258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] MFA Rules not processed for user `cf8c22086077473abddf02aec8ae29a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:03.565035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:03.665206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1038/2029] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:03.669666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.671088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:03.758455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b15d2-7f29-4618-b8f5-f4713ac570bd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.765208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.766040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.766161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.766631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.770037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.774187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.816593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 992/2030] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:03 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:03.817834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.829187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728880-a23d-4e41-94ef-ca79fda31513 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.909690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.912900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.913399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.913845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.916805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.918806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:03.938416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:03.947011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1039/2031] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:03 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:03.951258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:03.964420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef923-ead0-4163-8d90-e4fa03421402 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:03.969837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:03.971183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:03.971654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:03.972208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:03.973205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:03.975703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:04.004263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 993/2032] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:04.007907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:04.019071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f77de5-9514-42ba-818f-e3a93c6a1579 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:04.026829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:04.027723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.028040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.028368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] PATH_INFO: `/v3/projects/5652853f498941f9b866c521a5a336d6/users/0ee2a52f19664c4398bd9c9fc67b2e97/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.047753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5652853f498941f9b866c521a5a336d6, user_id=0ee2a52f19664c4398bd9c9fc67b2e97, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:04.051088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:04.070741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1040/2033] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:04 2022] PUT /identity/v3/projects/5652853f498941f9b866c521a5a336d6/users/0ee2a52f19664c4398bd9c9fc67b2e97/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:04.072110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:04.082930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583062a-cf0b-4e98-8bb4-678b4511ca11 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:04.087952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:04.161750 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52919fc6-dccc-4991-a126-00babec12c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:04.162369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52919fc6-dccc-4991-a126-00babec12c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.162906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52919fc6-dccc-4991-a126-00babec12c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.162906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52919fc6-dccc-4991-a126-00babec12c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.163720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52919fc6-dccc-4991-a126-00babec12c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:04.165376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52919fc6-dccc-4991-a126-00babec12c40 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:04.181363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 994/2034] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:04.183156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:04.194976 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd03d33-4c73-4230-a915-f9749e11c8e2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:04.200363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:04.201140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.201490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.201830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] PATH_INFO: `/v3/projects/5652853f498941f9b866c521a5a336d6/users/0ee2a52f19664c4398bd9c9fc67b2e97/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.205909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5652853f498941f9b866c521a5a336d6, user_id=0ee2a52f19664c4398bd9c9fc67b2e97, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:04.210123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:04.234194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1041/2035] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:04 2022] PUT /identity/v3/projects/5652853f498941f9b866c521a5a336d6/users/0ee2a52f19664c4398bd9c9fc67b2e97/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:04.235331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.236131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.236131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.320955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] MFA Rules not processed for user `0ee2a52f19664c4398bd9c9fc67b2e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:04.322500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:04.425842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:04.432805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:04.468504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 995/2036] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:04.484379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:04.490138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:04.608340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15a31-362a-4311-97c8-b62561957e4a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:04.609669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e43580-dfe7-4547-96b8-e199e58ba7e0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:04.616662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:04.617357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.617636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.617912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] PATH_INFO: `/v3/projects/d47e61a7f98c4f14ad86fd639963b68d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.618978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:04.619877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47e61a7f98c4f14ad86fd639963b68d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:04.620117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.621107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.621540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.622264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:04.624778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:04.738760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47e61a7f98c4f14ad86fd639963b68d', 'request_id': 'req-560cbacb-1b22-409c-8d97-b9c261727989'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:04.750236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47e61a7f98c4f14ad86fd639963b68d', 'request_id': 'req-560cbacb-1b22-409c-8d97-b9c261727989'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:04.755433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:04.764524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47e61a7f98c4f14ad86fd639963b68d', 'request_id': 'req-560cbacb-1b22-409c-8d97-b9c261727989'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:04.782117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] The token cache is being invalidate because project d47e61a7f98c4f14ad86fd639963b68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:04.782670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:04.793882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-560cbacb-1b22-409c-8d97-b9c261727989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:04.794548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:04.794641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1042/2037] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:04 2022] DELETE /identity/v3/projects/d47e61a7f98c4f14ad86fd639963b68d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:04.794714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550869b-ade0-4e3b-bc4e-2bd4ae79b85c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:04.795873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.796033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.796890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:04.817731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 996/2038] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:04.835121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:04.837416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:04.908606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:04.944454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1043/2039] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:04.951860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:04.952107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:04.952405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.009472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:05.012394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:05.042563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 997/2040] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:05.044105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.062501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da7019-535b-4671-8e56-263e9d56bb5f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.072593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.073434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.073804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.076426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.077846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:05.077846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.079882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:05.101768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1044/2041] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:05.114210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.127731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d02b4-595a-4096-910e-9187e3559831 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.136759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.137733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.138684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.139001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.139960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.145953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:05.187619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.194586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 998/2042] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:05 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:05.200228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fd949-e70e-4698-90b1-c85e4a15e1f2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.331806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.332589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.332984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.333332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.335637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.337793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:05.387729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1045/2043] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:05 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:05.393147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.408970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb79b-1f26-4933-963d-ba15ba16929e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.421160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.422997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.423434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.423707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.424513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.431085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:05.456371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.462487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 999/2044] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:05.471722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606c5cf-7e02-4cde-a69c-006ea09407cf admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.485148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5301-758b-4bd5-8012-9aefd35a1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.488711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5301-758b-4bd5-8012-9aefd35a1243 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.489408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5301-758b-4bd5-8012-9aefd35a1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.489974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5301-758b-4bd5-8012-9aefd35a1243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.490998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5301-758b-4bd5-8012-9aefd35a1243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.492842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5301-758b-4bd5-8012-9aefd35a1243 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:05.509819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1046/2045] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:05.513401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.535346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d095-a07d-4a2f-9e22-c892a84b2b7b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.551610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.552444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.552876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.553151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] PATH_INFO: `/v3/projects/6336b63974b94564b5e1ade09a5ef9ee/users/475b541a48b14f9fb652b5eb621b9e4a/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.583735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6336b63974b94564b5e1ade09a5ef9ee, user_id=475b541a48b14f9fb652b5eb621b9e4a, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.586967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:05.605472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1000/2046] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:05 2022] PUT /identity/v3/projects/6336b63974b94564b5e1ade09a5ef9ee/users/475b541a48b14f9fb652b5eb621b9e4a/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:05.616236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.616641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.616982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.662228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] MFA Rules not processed for user `475b541a48b14f9fb652b5eb621b9e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:05.666226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:05.808824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1047/2047] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:05.812059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:05.940595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5cf17-8b8d-4a63-961e-3d606f7b2485 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:05.961370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:05.963153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:05.963432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:05.963786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:05.964399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:05.966480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.010512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1001/2048] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:05 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:06.014489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.031691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba5b5c-1b5b-4cc4-9998-140bbcb77121 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.107226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:06.143707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.143707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.143707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.143707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.144167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:06.148257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.193074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1048/2049] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:06 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:06.194176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.207498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d814-0865-4616-a6e7-56ec6a549cb4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.213342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.213949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.214227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.214499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.215204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:06.217343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.236948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.248407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1002/2050] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:06.253988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d0c26-a5c2-4588-a353-5eea27211282 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.260651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.261834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.262485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.262920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] PATH_INFO: `/v3/projects/f280c0ac57174b66803082d47da4c02f/users/2001bdaea0e04ea4b6d66bdc0ca4b9a1/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.286743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f280c0ac57174b66803082d47da4c02f, user_id=2001bdaea0e04ea4b6d66bdc0ca4b9a1, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:06.291176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.316639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1049/2051] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:06 2022] PUT /identity/v3/projects/f280c0ac57174b66803082d47da4c02f/users/2001bdaea0e04ea4b6d66bdc0ca4b9a1/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:06.316803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.325048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23b23-ca62-4a58-b9ec-87711feb4c14 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.391529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:06.399651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04cc-1917-4d70-a5e7-11a31bda74bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.400331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04cc-1917-4d70-a5e7-11a31bda74bc admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.400891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04cc-1917-4d70-a5e7-11a31bda74bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.401257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04cc-1917-4d70-a5e7-11a31bda74bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.402593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04cc-1917-4d70-a5e7-11a31bda74bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:06.405261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04cc-1917-4d70-a5e7-11a31bda74bc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.419806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1003/2052] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:06.424383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.445432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afff6-c4ad-4e9e-8c40-8f4ef0202007 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.474784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.475556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.475751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.476002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] PATH_INFO: `/v3/projects/f280c0ac57174b66803082d47da4c02f/users/2001bdaea0e04ea4b6d66bdc0ca4b9a1/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.478011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f280c0ac57174b66803082d47da4c02f, user_id=2001bdaea0e04ea4b6d66bdc0ca4b9a1, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:06.480990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.506055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1050/2053] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:06 2022] PUT /identity/v3/projects/f280c0ac57174b66803082d47da4c02f/users/2001bdaea0e04ea4b6d66bdc0ca4b9a1/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:06.508442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.508804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.509085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.571272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] MFA Rules not processed for user `2001bdaea0e04ea4b6d66bdc0ca4b9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:06.572674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:06.728390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1004/2054] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:06.749703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.757329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:06.803801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:06.805755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:06.863639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f293-47ea-4a09-b829-4a95b7d85a05 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.868486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.869175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.869539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.870125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.888669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9a73-cdc2-43ad-94bb-8422fafda65a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:06.901248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:06.901876 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:06.902296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:06.902575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:06.906644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:06.949390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:06.951468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:06.980863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1051/2055] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:07.003922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:07.005861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:07.019053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1005/2056] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:08.067909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:08.083166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708ed87-68dd-40df-89f6-25d193a9f0c0 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:08.091661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:08.092415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:08.092833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:08.093398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:08.096375 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:08.181249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:08.210613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:08.213500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:08.229762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1052/2057] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:09.977122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:09.986954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2193de-3cfe-4f96-8e42-bb9b7cb662ac service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:09.991204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9d53a-ccca-4944-81bf-22119a3996c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:09.991877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9d53a-ccca-4944-81bf-22119a3996c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:09.992163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9d53a-ccca-4944-81bf-22119a3996c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:09.992435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9d53a-ccca-4944-81bf-22119a3996c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:10.005008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9d53a-ccca-4944-81bf-22119a3996c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:10.007984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9d53a-ccca-4944-81bf-22119a3996c4 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:10.024881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1006/2058] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:12.613434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:12.616327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:12.728911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5185-2383-4b00-897e-5c91c13dd3c1 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:12.735352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:12.736107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:12.737272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:12.737661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] PATH_INFO: `/v3/users/0e7a9872bd6a40d381920c2a21510d5f` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:12.739010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7a9872bd6a40d381920c2a21510d5f)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:12.741289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:12.818525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7a9872bd6a40d381920c2a21510d5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:12.826480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7a9872bd6a40d381920c2a21510d5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:12.827462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7a9872bd6a40d381920c2a21510d5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:12.828260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7a9872bd6a40d381920c2a21510d5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:12.838602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7a9872bd6a40d381920c2a21510d5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:12.864289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1053/2059] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:12 2022] DELETE /identity/v3/users/0e7a9872bd6a40d381920c2a21510d5f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:12.869455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:12.869983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:12.871317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:12.899902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:12.901654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:12.920308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:13.014308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1007/2060] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:13.025533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:13.026975 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:13.101566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae49a-dfe9-4e66-9d02-35b57bbbcbdf admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:13.106197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:13.107092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:13.107372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:13.107644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:13.118846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:13.120285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:13.134086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1054/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:13.560298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:13.562048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:13.576576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1285a7a-be99-4ebe-b9e9-716fded100c2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:13.583283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:13.584860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:13.585188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:13.585469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] PATH_INFO: `/v3/projects/9010455b4e0d4caca90627bc66c55819` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:13.587548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9010455b4e0d4caca90627bc66c55819)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:13.590234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:13.663267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9010455b4e0d4caca90627bc66c55819', 'request_id': 'req-fe138fc9-ccc3-46a0-97eb-60da59c826fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.680809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9010455b4e0d4caca90627bc66c55819', 'request_id': 'req-fe138fc9-ccc3-46a0-97eb-60da59c826fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.702773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9010455b4e0d4caca90627bc66c55819', 'request_id': 'req-fe138fc9-ccc3-46a0-97eb-60da59c826fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.731127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] The token cache is being invalidate because project 9010455b4e0d4caca90627bc66c55819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:13.731446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.732201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.738670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1008/2062] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:13 2022] DELETE /identity/v3/projects/9010455b4e0d4caca90627bc66c55819 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:13.748864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:13.760716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c8475-38e6-43b3-9aa0-6e59b6f7c5d8 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:13.766254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:13.875818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:13.877249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:13.878318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:13.878672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] PATH_INFO: `/v3/users/cf8c22086077473abddf02aec8ae29a3` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:13.880196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8c22086077473abddf02aec8ae29a3)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:13.882524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:13.941665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8c22086077473abddf02aec8ae29a3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.953318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8c22086077473abddf02aec8ae29a3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.955184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8c22086077473abddf02aec8ae29a3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.956389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8c22086077473abddf02aec8ae29a3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.968398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4ec67cc6-741b-43d9-90ca-e82cf62e0bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8c22086077473abddf02aec8ae29a3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:13.991769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1055/2063] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:13 2022] DELETE /identity/v3/users/cf8c22086077473abddf02aec8ae29a3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:14.620452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:14.622313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:14.635784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe138fc9-ccc3-46a0-97eb-60da59c826fa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:14.700267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:14.701481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:14.701796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:14.702073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] PATH_INFO: `/v3/projects/e04f7c88ec16433d8c8937feec9878a6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:14.703227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04f7c88ec16433d8c8937feec9878a6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:14.705213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:14.767949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a6d21-604b-4d9f-87c3-531207c30611 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:14.768535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a6d21-604b-4d9f-87c3-531207c30611 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:14.768535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a6d21-604b-4d9f-87c3-531207c30611 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:14.770462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1056/2064] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:21:14.771746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:14.777105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04f7c88ec16433d8c8937feec9878a6', 'request_id': 'req-81726070-8c9d-4101-93f7-13bb78c32f33'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:14.784886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04f7c88ec16433d8c8937feec9878a6', 'request_id': 'req-81726070-8c9d-4101-93f7-13bb78c32f33'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:14.805806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04f7c88ec16433d8c8937feec9878a6', 'request_id': 'req-81726070-8c9d-4101-93f7-13bb78c32f33'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:14.816648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:14.817013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:14.817505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:14.819074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] The token cache is being invalidate because project e04f7c88ec16433d8c8937feec9878a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:14.819433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:14.820263 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:14.824668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1009/2065] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:14 2022] DELETE /identity/v3/projects/e04f7c88ec16433d8c8937feec9878a6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:14.826403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:14.829318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:14.841221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:14.842467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:14.927370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1057/2066] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:14.928280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:14.928525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81726070-8c9d-4101-93f7-13bb78c32f33 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:14.932184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:14.934291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:14.935248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:14.935529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:14.935802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] PATH_INFO: `/v3/users/0ee2a52f19664c4398bd9c9fc67b2e97` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:14.936995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee2a52f19664c4398bd9c9fc67b2e97)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:14.938998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:14.946378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a1c0-1534-46b7-bc8f-f2a0fa5adb99 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:14.951147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:14.951823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:14.952131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:14.952402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] PATH_INFO: `/v3/users/f617c22150914a45887bd29cf2d5feac` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:14.953582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f617c22150914a45887bd29cf2d5feac)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:14.956343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:14.988248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:15.004485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee2a52f19664c4398bd9c9fc67b2e97'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.013348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee2a52f19664c4398bd9c9fc67b2e97'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.014040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee2a52f19664c4398bd9c9fc67b2e97'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.014841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee2a52f19664c4398bd9c9fc67b2e97'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.025144 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee2a52f19664c4398bd9c9fc67b2e97'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.025461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f617c22150914a45887bd29cf2d5feac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.034934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f617c22150914a45887bd29cf2d5feac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.035729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f617c22150914a45887bd29cf2d5feac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.036356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f617c22150914a45887bd29cf2d5feac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.045229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f617c22150914a45887bd29cf2d5feac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.052303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1010/2067] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:14 2022] DELETE /identity/v3/users/0ee2a52f19664c4398bd9c9fc67b2e97 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:15.053390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.055182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.071824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1058/2068] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:14 2022] DELETE /identity/v3/users/f617c22150914a45887bd29cf2d5feac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:15.158577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:15.201647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927541e-0ace-45c7-9a91-0e19df025e6b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.287738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.288492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.288794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.289062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.290825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.303095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.305625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.322736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1011/2069] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:15.354855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.356460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.437373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d5880-d95c-48f5-9667-f6fd12b5cbba admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.443180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.443936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.444318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.444733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] PATH_INFO: `/v3/projects/e8166c97642549a7ad92de4f901078c0` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.446222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8166c97642549a7ad92de4f901078c0)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.447349 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.448598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.450246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.466011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a62e-9a13-4c7f-88fe-6d2e1c2d3630 service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.471313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.471852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.472147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.472408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] PATH_INFO: `/v3/projects/5652853f498941f9b866c521a5a336d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.473961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5652853f498941f9b866c521a5a336d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.475496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.523081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8166c97642549a7ad92de4f901078c0', 'request_id': 'req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.529408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8166c97642549a7ad92de4f901078c0', 'request_id': 'req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.540858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8166c97642549a7ad92de4f901078c0', 'request_id': 'req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.540961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5652853f498941f9b866c521a5a336d6', 'request_id': 'req-d199295b-3e3d-4414-9128-05a6ac3cb681'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.546616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5652853f498941f9b866c521a5a336d6', 'request_id': 'req-d199295b-3e3d-4414-9128-05a6ac3cb681'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.555154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5652853f498941f9b866c521a5a336d6', 'request_id': 'req-d199295b-3e3d-4414-9128-05a6ac3cb681'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.557133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] The token cache is being invalidate because project e8166c97642549a7ad92de4f901078c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:15.557530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.560723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d2ff1b03-f0b6-4ee9-aeba-94729fb24673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.562732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1059/2070] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:15 2022] DELETE /identity/v3/projects/e8166c97642549a7ad92de4f901078c0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:15.568026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e55b0-0bf9-455e-915c-d7a4264effb6 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.568668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e55b0-0bf9-455e-915c-d7a4264effb6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.570346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e55b0-0bf9-455e-915c-d7a4264effb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.578071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] The token cache is being invalidate because project 5652853f498941f9b866c521a5a336d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:15.578550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.579248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d199295b-3e3d-4414-9128-05a6ac3cb681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:15.582099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1012/2071] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:15 2022] DELETE /identity/v3/projects/5652853f498941f9b866c521a5a336d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:15.587098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1ecc-e369-4782-b85d-1cccf19f62ae None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.587513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1ecc-e369-4782-b85d-1cccf19f62ae None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.587891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1ecc-e369-4782-b85d-1cccf19f62ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.592067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e18e55b0-0bf9-455e-915c-d7a4264effb6 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:15.593340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e18e55b0-0bf9-455e-915c-d7a4264effb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.611692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-706b1ecc-e369-4782-b85d-1cccf19f62ae None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:15.613107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-706b1ecc-e369-4782-b85d-1cccf19f62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.619025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:15.675179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1060/2072] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:15.684021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.684672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.685147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.689945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1013/2073] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:15.698303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.698683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.699065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.710408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:15.712299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.730153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:15.731047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1061/2074] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:15.741353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.742944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:15.745229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:15.758592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a583-b15a-4248-9b0e-ed93fc9996d5 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.758729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1014/2075] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:15.760120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.760977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.761729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.762459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.762459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.763058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:15.763396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.765152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.773441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265d959-c9d2-4d95-9e14-7ed8eddd7c11 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.778133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1062/2076] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:21:15.778647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.779342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.779623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.779971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.780732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:15.781090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.782737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.783618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.795580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5db5-9f51-4008-bd3c-786877024b1d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.796797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1015/2077] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:15.801433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.802555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.803240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.803593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.803942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.804793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.806713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.812190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1d12-aff4-45b7-950c-3015b5c318d1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.821129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.821835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.822243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.823054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.823755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.826009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.836831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1063/2078] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:15.841023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.868772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1016/2079] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:15.868772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.921422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de6ec-247b-49ed-9772-aa5fb5ee460f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.946422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3e2b7-4740-4c12-9652-676ac2d35e0e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:15.952527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.953404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.953849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.954827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:15.955616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:15.957568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:15.985297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1017/2080] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:15.989782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:15.998213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:15.998931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:15.999271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:15.999610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.000305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.001012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527b36-9db7-488f-a2e7-aba44157e579 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.004082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.006534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.007220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.007568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.007915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.008683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.010380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.022455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1018/2081] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:16.026094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.034508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1064/2082] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:15 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:16.035627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.038162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8288-02fa-4be8-899a-7e693468162b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.043414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.044190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.045399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.045399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.046108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.048546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.058398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9903aab-ed1f-46dd-8795-d4a4ea9fa2f2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.060892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1019/2083] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:16.065412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.067538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.068150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.068420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.068723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.069419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.070982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.076287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4877a1b-ed16-4b2f-b306-4cd604ae2617 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.081673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b40bc4-b192-4047-bb19-d6adc2a487ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.084597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1065/2084] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:16.084740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40bc4-b192-4047-bb19-d6adc2a487ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.084740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40bc4-b192-4047-bb19-d6adc2a487ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.084740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40bc4-b192-4047-bb19-d6adc2a487ca admin admin] PATH_INFO: `/v3/projects/df609b88d75f4981860be8484c6b0a79/users/dda80d351ec04db6a15890546b3d2216/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.085876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.095747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222c0b-37f6-4bd0-b772-2ed4d43b5aae admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.097859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b40bc4-b192-4047-bb19-d6adc2a487ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=df609b88d75f4981860be8484c6b0a79, user_id=dda80d351ec04db6a15890546b3d2216, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.100486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b40bc4-b192-4047-bb19-d6adc2a487ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.100659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.101175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.101456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.101732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.102367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.103942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.110240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:16.117954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1066/2085] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:16.121427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.123162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1020/2086] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:16 2022] PUT /identity/v3/projects/df609b88d75f4981860be8484c6b0a79/users/dda80d351ec04db6a15890546b3d2216/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:16.131839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646342d6-2bc6-4c84-b473-99f191728aac admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.133719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.133997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.134269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.162010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] MFA Rules not processed for user `dda80d351ec04db6a15890546b3d2216`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:16.163319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:16.191067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fc330-1517-4770-97d1-f8d94f6b1712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.191633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fc330-1517-4770-97d1-f8d94f6b1712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.191904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fc330-1517-4770-97d1-f8d94f6b1712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.192171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fc330-1517-4770-97d1-f8d94f6b1712 admin admin] PATH_INFO: `/v3/projects/61280635625e4ba680a2da6f71c72e22/users/0b74cad47e9a4dd1b8b931d3934ae70d/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.207512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fc330-1517-4770-97d1-f8d94f6b1712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61280635625e4ba680a2da6f71c72e22, user_id=0b74cad47e9a4dd1b8b931d3934ae70d, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.210341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fc330-1517-4770-97d1-f8d94f6b1712 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.224587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1067/2087] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:16 2022] PUT /identity/v3/projects/61280635625e4ba680a2da6f71c72e22/users/0b74cad47e9a4dd1b8b931d3934ae70d/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:16.229519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.229841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.230112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.236767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:16.243445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1021/2088] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:16.250005 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:16.251818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:16.254723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.256247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:16.330612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9d412-3a57-472d-a712-d1e8896fea19 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.333644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1068/2089] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:16.340834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:16.343147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:16.390522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.391231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.391558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.391908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.423640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d6f3-2cda-4ac3-abf3-2c8dbf077364 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:16.430160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e8b7b-19eb-469c-bea7-d55c21997e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:16.430769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e8b7b-19eb-469c-bea7-d55c21997e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:16.431040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e8b7b-19eb-469c-bea7-d55c21997e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:16.431309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e8b7b-19eb-469c-bea7-d55c21997e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:16.441431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e8b7b-19eb-469c-bea7-d55c21997e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.442846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e8b7b-19eb-469c-bea7-d55c21997e23 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.452699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1069/2090] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:16.483480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:16.485153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:16.496625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1022/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:18.026919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c878b-3005-43f9-96eb-70123b2edda1 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:18.027902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c878b-3005-43f9-96eb-70123b2edda1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:18.028275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c878b-3005-43f9-96eb-70123b2edda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:18.050347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-679c878b-3005-43f9-96eb-70123b2edda1 None None] MFA Rules not processed for user `dda80d351ec04db6a15890546b3d2216`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:18.051568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-679c878b-3005-43f9-96eb-70123b2edda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:18.060497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1070/2092] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:18.547795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:18.551988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:18.586345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f9d9-a797-4e73-a5d6-1fa98649f535 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:18.600723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:18.601583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:18.602055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:18.602428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] PATH_INFO: `/v3/users/06732a8b66f441809edef62be6424815` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:18.604506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=06732a8b66f441809edef62be6424815)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:18.609000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:18.702161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06732a8b66f441809edef62be6424815'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:18.712343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06732a8b66f441809edef62be6424815'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:18.713158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06732a8b66f441809edef62be6424815'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:18.713925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06732a8b66f441809edef62be6424815'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:18.726470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06732a8b66f441809edef62be6424815'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:18.728089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:18.752168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1023/2093] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:18 2022] DELETE /identity/v3/users/06732a8b66f441809edef62be6424815 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:18.756797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:18.758586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:18.758973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:18.784919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:18.786176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:18.828234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:18.890580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1071/2094] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:18.905297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:18.906441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:19.069353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba98599-1ac4-4d90-8e63-d3dcc91b05ad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:19.076536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:19.077369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:19.077765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:19.078192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:19.089844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:19.092141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:19.104160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1024/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:19.786062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:19.788077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:19.811886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d39e8d-3dc1-4103-a62b-7f5950d8e3f8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:19.829810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:19.830503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:19.830783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:19.831056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] PATH_INFO: `/v3/projects/8a0f78f6928945c6b97ec36ac8fc4346` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:19.833437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0f78f6928945c6b97ec36ac8fc4346)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:19.835362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:19.919985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0f78f6928945c6b97ec36ac8fc4346', 'request_id': 'req-d4dd5056-1cc7-4b52-a737-1b9f314240e4'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:19.941903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0f78f6928945c6b97ec36ac8fc4346', 'request_id': 'req-d4dd5056-1cc7-4b52-a737-1b9f314240e4'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:19.962138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0f78f6928945c6b97ec36ac8fc4346', 'request_id': 'req-d4dd5056-1cc7-4b52-a737-1b9f314240e4'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:19.996436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] The token cache is being invalidate because project 8a0f78f6928945c6b97ec36ac8fc4346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:19.996788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:19.998371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:20.011747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1072/2096] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:19 2022] DELETE /identity/v3/projects/8a0f78f6928945c6b97ec36ac8fc4346 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:20.012196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:20.025305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624a81c-46fd-4f59-8f6e-976d3e4e9ed1 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:20.114792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:20.115498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:20.115890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:20.116276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] PATH_INFO: `/v3/users/e0df8fc3772a45b4bc31e64725da8e0e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:20.117648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0df8fc3772a45b4bc31e64725da8e0e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:20.120356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:20.211673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0df8fc3772a45b4bc31e64725da8e0e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:20.223141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0df8fc3772a45b4bc31e64725da8e0e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:20.224239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0df8fc3772a45b4bc31e64725da8e0e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:20.225870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0df8fc3772a45b4bc31e64725da8e0e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:20.238353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-69760034-462b-41f0-82a0-7ea266c1aefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0df8fc3772a45b4bc31e64725da8e0e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:20.279089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1025/2097] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:20 2022] DELETE /identity/v3/users/e0df8fc3772a45b4bc31e64725da8e0e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:20.909818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:20.912343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:20.944867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd5056-1cc7-4b52-a737-1b9f314240e4 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:21.035024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:21.035766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.036049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.036297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] PATH_INFO: `/v3/projects/183cfcaf5938427e98be50220b444461` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.037475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183cfcaf5938427e98be50220b444461)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:21.040211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:21.105591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:21.111296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183cfcaf5938427e98be50220b444461', 'request_id': 'req-c2bfc50a-a598-41ca-845d-409d05df6b86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:21.124789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183cfcaf5938427e98be50220b444461', 'request_id': 'req-c2bfc50a-a598-41ca-845d-409d05df6b86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:21.148311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183cfcaf5938427e98be50220b444461', 'request_id': 'req-c2bfc50a-a598-41ca-845d-409d05df6b86'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:21.187438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] The token cache is being invalidate because project 183cfcaf5938427e98be50220b444461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:21.187791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:21.188525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c2bfc50a-a598-41ca-845d-409d05df6b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:21.191300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1073/2098] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:20 2022] DELETE /identity/v3/projects/183cfcaf5938427e98be50220b444461 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:21.195810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.196267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.196382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.206229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:21.257725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:21.268324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:21.400049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1026/2099] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:21.408244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.408523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.408948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.448367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:21.449581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:21.506189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1074/2100] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:21.508518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:21.523670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10d444-10d8-4a41-937a-758039ff059a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:21.533147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:21.533958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.534313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.534658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.535916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:21.536302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:21.539257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:21.562986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1027/2101] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:21:21.568784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:21.593280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51e51-6041-463c-b51a-41e81972d0d3 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:21.606031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:21.606856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.607232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.607789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.608535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:21.616294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:21.695478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1075/2102] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:21 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:21.699782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:21.715505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1b17-7e3a-4c08-a4d6-17e54b7ec907 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:21.862589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:21.863410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.863871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.864291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.865276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:21.868179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:21.914221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1028/2103] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:21 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:21.915337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:21.933982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6b50-b67b-4f2a-8de5-d018adda3368 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:21.947619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:21.948409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:21.948887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:21.949421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:21.951711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:21.957992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:21.983531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1076/2104] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:21.984139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.000988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98f9b-1ac2-42ca-8cd6-a20af60ced73 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.025558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f560-c377-47eb-b1a2-a960f9099942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:22.026295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f560-c377-47eb-b1a2-a960f9099942 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.026586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f560-c377-47eb-b1a2-a960f9099942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.026875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f560-c377-47eb-b1a2-a960f9099942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.027622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f560-c377-47eb-b1a2-a960f9099942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:22.029934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f560-c377-47eb-b1a2-a960f9099942 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:22.053992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1029/2105] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:22.056772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.069123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b248-3ecc-41d0-bb59-8e13dfe87b58 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.084676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee30a1e-e59d-43f7-b365-e27858ab2b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:22.085472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee30a1e-e59d-43f7-b365-e27858ab2b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.085761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee30a1e-e59d-43f7-b365-e27858ab2b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.086037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee30a1e-e59d-43f7-b365-e27858ab2b77 admin admin] PATH_INFO: `/v3/projects/0fc8be03fa1444bd907260fe13779af1/users/d09a209d83564966a2505e117d088b4d/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.108605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee30a1e-e59d-43f7-b365-e27858ab2b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc8be03fa1444bd907260fe13779af1, user_id=d09a209d83564966a2505e117d088b4d, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:22.114813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee30a1e-e59d-43f7-b365-e27858ab2b77 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:22.142419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1077/2106] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:22 2022] PUT /identity/v3/projects/0fc8be03fa1444bd907260fe13779af1/users/d09a209d83564966a2505e117d088b4d/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:22.154269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.154636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.154887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.203227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] MFA Rules not processed for user `d09a209d83564966a2505e117d088b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:22.205920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:22.291695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.291979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.292248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.324410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:22.338204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1030/2107] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:22.343869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.388056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] MFA Rules not processed for user `0b74cad47e9a4dd1b8b931d3934ae70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:22.389349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:22.475501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5474-d5e6-425a-b756-b34f02541c33 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.483495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:22.484199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.486113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.486529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.487347 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:22.494047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:22.582219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1031/2108] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:22 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:22.582447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1078/2109] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:22.595725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.731463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422fb9-3648-4342-aa0e-f816bfb46dcb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.746895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:22.747655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.747920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.748193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.748925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:22.751843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:22.795582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1032/2110] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:22 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:22.804681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.804681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:22.807240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.826944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d17d-14e9-4999-879e-1524fd27034a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.836011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:22.836846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.837193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.837542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.838416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:22.840451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:22.852885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1033/2111] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:22.862203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:22.875763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7ff49-ff1c-4ae8-8a8f-02bfae52a910 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.888215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:22.888919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:22.889195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:22.889656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] PATH_INFO: `/v3/projects/6a1f96f3048047cc9168c574c8acc3ee/users/eea0e1789f814fa4a16d590e896cccba/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:22.911256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:22.913034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f96f3048047cc9168c574c8acc3ee, user_id=eea0e1789f814fa4a16d590e896cccba, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:22.915621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:22.936250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1034/2112] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:22 2022] PUT /identity/v3/projects/6a1f96f3048047cc9168c574c8acc3ee/users/eea0e1789f814fa4a16d590e896cccba/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:22.940122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8990cc-0661-4b53-b041-2d77874c5514 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:22.940926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:23.000065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:23.033926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffcc37-c5bb-44d3-b68b-183ea489a0cf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:23.037253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:23.037872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:23.038145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:23.038861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:23.039688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:23.040370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:23.040749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:23.041162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:23.041824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:23.043513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:23.059934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1035/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:23.061713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:23.085565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e9bde-4b92-494c-96f1-2fc53e58e118 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:23.091328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab05be8-ceea-4133-9312-ea2295a507d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:23.092135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab05be8-ceea-4133-9312-ea2295a507d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:23.092480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab05be8-ceea-4133-9312-ea2295a507d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:23.092853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab05be8-ceea-4133-9312-ea2295a507d8 admin admin] PATH_INFO: `/v3/projects/6a1f96f3048047cc9168c574c8acc3ee/users/eea0e1789f814fa4a16d590e896cccba/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:23.095037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab05be8-ceea-4133-9312-ea2295a507d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f96f3048047cc9168c574c8acc3ee, user_id=eea0e1789f814fa4a16d590e896cccba, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:23.099209 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab05be8-ceea-4133-9312-ea2295a507d8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:23.122245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1036/2114] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:23 2022] PUT /identity/v3/projects/6a1f96f3048047cc9168c574c8acc3ee/users/eea0e1789f814fa4a16d590e896cccba/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:23.128737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:23.128737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:23.128737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:23.153885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:23.155503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:23.190314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1079/2115] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:23.208188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] MFA Rules not processed for user `eea0e1789f814fa4a16d590e896cccba`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:23.210669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:23.360658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1037/2116] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:23.373947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:23.376810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:23.472094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba71ab-a117-4bdd-baed-a06b0cc79791 service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:23.570832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501adbe-61b5-4da5-9e8c-a27c04797b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:23.572971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501adbe-61b5-4da5-9e8c-a27c04797b32 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:23.573504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501adbe-61b5-4da5-9e8c-a27c04797b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:23.574009 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501adbe-61b5-4da5-9e8c-a27c04797b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:23.595564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:23.603307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501adbe-61b5-4da5-9e8c-a27c04797b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:23.606109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501adbe-61b5-4da5-9e8c-a27c04797b32 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:23.638161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1080/2117] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:23.832299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:23.945897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850b79-e1e0-4134-8dd6-e8690b74bc6b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:23.954665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:23.955422 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:23.955773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:23.956114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] PATH_INFO: `/v3/users/d09a209d83564966a2505e117d088b4d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:23.957661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09a209d83564966a2505e117d088b4d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:23.959689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:24.046476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09a209d83564966a2505e117d088b4d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.050492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:24.064507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09a209d83564966a2505e117d088b4d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.066907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09a209d83564966a2505e117d088b4d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.071767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09a209d83564966a2505e117d088b4d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.091565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09a209d83564966a2505e117d088b4d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.127907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1038/2118] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:23 2022] DELETE /identity/v3/users/d09a209d83564966a2505e117d088b4d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:24.132648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:24.133139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:24.133250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:24.172582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:24.174371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:24.243276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1081/2119] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:24.253378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:24.254984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:24.335074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d92c80-7300-4db2-92d7-b57737ef3222 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:24.340293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a8038-f91b-47f1-bb30-91843eaf2e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:24.341210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a8038-f91b-47f1-bb30-91843eaf2e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:24.341624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a8038-f91b-47f1-bb30-91843eaf2e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:24.342000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a8038-f91b-47f1-bb30-91843eaf2e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:24.357519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a8038-f91b-47f1-bb30-91843eaf2e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:24.360355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a8038-f91b-47f1-bb30-91843eaf2e61 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:24.381720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:24.383271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1039/2120] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:24.384727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:24.399776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b302ac-b66a-4d10-b222-0ebf3a42253d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:24.410917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:24.411795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:24.412238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:24.412730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] PATH_INFO: `/v3/users/475b541a48b14f9fb652b5eb621b9e4a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:24.414304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] RBAC: Authorizing `identity:delete_user(user_id=475b541a48b14f9fb652b5eb621b9e4a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:24.416461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:24.507496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475b541a48b14f9fb652b5eb621b9e4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.521716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475b541a48b14f9fb652b5eb621b9e4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.526319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475b541a48b14f9fb652b5eb621b9e4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.526319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475b541a48b14f9fb652b5eb621b9e4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.545753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475b541a48b14f9fb652b5eb621b9e4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.606472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1082/2121] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:24 2022] DELETE /identity/v3/users/475b541a48b14f9fb652b5eb621b9e4a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:24.611512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:24.611990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:24.612265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:24.669979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:24.671304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:24.765540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1040/2122] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:24.781241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:24.783175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:24.849967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:24.851598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:24.882307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd1890-5b34-4b57-a50e-6cb2d5a92435 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:24.885076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4b3d8-bfba-4777-95ec-578356d0ecce admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:24.894438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:24.894653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:24.895308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:24.895425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:24.895584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:24.895846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:24.895978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] PATH_INFO: `/v3/projects/0fc8be03fa1444bd907260fe13779af1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:24.896295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:24.897264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc8be03fa1444bd907260fe13779af1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:24.899239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:24.908130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:24.909785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:24.920847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1083/2123] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:24.968523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc8be03fa1444bd907260fe13779af1', 'request_id': 'req-881f1634-6766-46b9-b212-58afb203374a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.977708 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc8be03fa1444bd907260fe13779af1', 'request_id': 'req-881f1634-6766-46b9-b212-58afb203374a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:24.982443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:24.989336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc8be03fa1444bd907260fe13779af1', 'request_id': 'req-881f1634-6766-46b9-b212-58afb203374a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.007588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] The token cache is being invalidate because project 0fc8be03fa1444bd907260fe13779af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:25.008002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.008873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-881f1634-6766-46b9-b212-58afb203374a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.012758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1041/2124] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:24 2022] DELETE /identity/v3/projects/0fc8be03fa1444bd907260fe13779af1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:25.017498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:25.036604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187f06-5226-4e4a-b7a0-42c3796a5caa service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:25.042285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:25.116318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:25.117020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:25.117301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:25.117579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] PATH_INFO: `/v3/users/eea0e1789f814fa4a16d590e896cccba` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:25.118772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea0e1789f814fa4a16d590e896cccba)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:25.120799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:25.217321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea0e1789f814fa4a16d590e896cccba'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.230868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea0e1789f814fa4a16d590e896cccba'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.231618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea0e1789f814fa4a16d590e896cccba'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.236171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea0e1789f814fa4a16d590e896cccba'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.258972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea0e1789f814fa4a16d590e896cccba'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.290295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1084/2125] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:25 2022] DELETE /identity/v3/users/eea0e1789f814fa4a16d590e896cccba => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:25.356360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:25.356930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:25.357457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:25.386442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] MFA Rules not processed for user `0b74cad47e9a4dd1b8b931d3934ae70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:25.393776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:25.485019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:25.487325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:25.512763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1042/2126] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:25.598912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a649f-87a2-4640-816e-94e961e31e01 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:25.604171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:25.604844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:25.605126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:25.605451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] PATH_INFO: `/v3/projects/6336b63974b94564b5e1ade09a5ef9ee` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:25.607616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6336b63974b94564b5e1ade09a5ef9ee)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:25.611183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:25.689864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:25.746314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6336b63974b94564b5e1ade09a5ef9ee', 'request_id': 'req-e4ae4b18-b52e-401d-8da5-5a643275d374'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.769285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6336b63974b94564b5e1ade09a5ef9ee', 'request_id': 'req-e4ae4b18-b52e-401d-8da5-5a643275d374'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.796129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6336b63974b94564b5e1ade09a5ef9ee', 'request_id': 'req-e4ae4b18-b52e-401d-8da5-5a643275d374'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.835166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] The token cache is being invalidate because project 6336b63974b94564b5e1ade09a5ef9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:25.835680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.836507 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:25.838540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1085/2127] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:25 2022] DELETE /identity/v3/projects/6336b63974b94564b5e1ade09a5ef9ee => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:25.842593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:25.865818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0299ff-9454-47d6-bea8-864bbe801b28 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:25.887475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:25.889054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:25.998962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:25.999985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.000440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.001788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] PATH_INFO: `/v3/users/2001bdaea0e04ea4b6d66bdc0ca4b9a1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.003234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2001bdaea0e04ea4b6d66bdc0ca4b9a1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.007705 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.010332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae4b18-b52e-401d-8da5-5a643275d374 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.016001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.017791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.018236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.018712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] PATH_INFO: `/v3/projects/6a1f96f3048047cc9168c574c8acc3ee` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.019952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1f96f3048047cc9168c574c8acc3ee)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.022480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.105339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2001bdaea0e04ea4b6d66bdc0ca4b9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.107095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1f96f3048047cc9168c574c8acc3ee', 'request_id': 'req-0cd24d44-808e-472d-bd74-a9b734c0fec7'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.115372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1f96f3048047cc9168c574c8acc3ee', 'request_id': 'req-0cd24d44-808e-472d-bd74-a9b734c0fec7'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.117277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2001bdaea0e04ea4b6d66bdc0ca4b9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.119459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2001bdaea0e04ea4b6d66bdc0ca4b9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.121335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2001bdaea0e04ea4b6d66bdc0ca4b9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.127863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1f96f3048047cc9168c574c8acc3ee', 'request_id': 'req-0cd24d44-808e-472d-bd74-a9b734c0fec7'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.135369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c62dd27-645a-4da0-88fd-7ed939935025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2001bdaea0e04ea4b6d66bdc0ca4b9a1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.147553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] The token cache is being invalidate because project 6a1f96f3048047cc9168c574c8acc3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:26.151526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.152603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cd24d44-808e-472d-bd74-a9b734c0fec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:26.156692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1086/2128] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:25 2022] DELETE /identity/v3/projects/6a1f96f3048047cc9168c574c8acc3ee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:26.162090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.162369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.162641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.173922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1043/2129] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:25 2022] DELETE /identity/v3/users/2001bdaea0e04ea4b6d66bdc0ca4b9a1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:26.215665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:26.217901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:26.340246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:26.371564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1087/2130] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:26.372685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.373155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.373357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.415244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:26.416341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:26.437149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1044/2131] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:26.440032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.462614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7ab09-9dbc-43a9-b74f-f0ba32026e15 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.479372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.481527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.482110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.484102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.487981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:26.488535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.494565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.520415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1088/2132] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:26.520691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.540068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fee4a4-f669-4642-8a10-941a67113593 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.546637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.547562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.548529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.549012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.549786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.551852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.559747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:26.613217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1045/2133] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:26 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:26.617216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.632627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce70ce6-c95a-475d-b91b-af4ad0ddf102 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.741252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.741495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.741864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.749672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.750453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.753866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.772027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.774047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:26.784439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1089/2134] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:26 2022] POST /identity/v3/users => generated 280 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:26.785691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.800095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fb64e-6377-416d-afce-f2bad6d94638 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.803457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601b52-e185-454a-afd0-333f6edfbac6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.821862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.824412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.825057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.825670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.825875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.826615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] PATH_INFO: `/v3/projects/f280c0ac57174b66803082d47da4c02f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.827121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.827498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.829937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f280c0ac57174b66803082d47da4c02f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.832960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.834418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.852441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.864908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1090/2135] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:26.869260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.883156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306afac-59c2-4e24-91eb-e8aec2e4a872 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.890058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.891090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.892196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.892988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.894672 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:26.896144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:26.910826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1091/2136] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:26.914979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:26.926626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2765-0702-409b-8147-4283cc5a91a8 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:26.932977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a435bb9-56c0-4871-b41f-7ad1e9c95d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:26.948145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a435bb9-56c0-4871-b41f-7ad1e9c95d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:26.948597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a435bb9-56c0-4871-b41f-7ad1e9c95d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:26.949040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a435bb9-56c0-4871-b41f-7ad1e9c95d6d admin admin] PATH_INFO: `/v3/projects/523c39fd62aa49588f00962dcdc13384/users/d0670431042246e19f19492d5c8068e5/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:26.985775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f280c0ac57174b66803082d47da4c02f', 'request_id': 'req-7978d587-aa04-4921-821e-49295d9cec7d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.015496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a435bb9-56c0-4871-b41f-7ad1e9c95d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=523c39fd62aa49588f00962dcdc13384, user_id=d0670431042246e19f19492d5c8068e5, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.018704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a435bb9-56c0-4871-b41f-7ad1e9c95d6d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.024290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f280c0ac57174b66803082d47da4c02f', 'request_id': 'req-7978d587-aa04-4921-821e-49295d9cec7d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.037736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f280c0ac57174b66803082d47da4c02f', 'request_id': 'req-7978d587-aa04-4921-821e-49295d9cec7d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.061617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] The token cache is being invalidate because project f280c0ac57174b66803082d47da4c02f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:27.061911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.062814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7978d587-aa04-4921-821e-49295d9cec7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.068959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1046/2137] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:26 2022] DELETE /identity/v3/projects/f280c0ac57174b66803082d47da4c02f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:27.069843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1092/2138] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:26 2022] PUT /identity/v3/projects/523c39fd62aa49588f00962dcdc13384/users/d0670431042246e19f19492d5c8068e5/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:27.078166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.078449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.078725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.083163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddbee-9ec0-4f2a-8e0e-f9b90289891c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.083660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddbee-9ec0-4f2a-8e0e-f9b90289891c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.084195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddbee-9ec0-4f2a-8e0e-f9b90289891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.150476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-638ddbee-9ec0-4f2a-8e0e-f9b90289891c None None] MFA Rules not processed for user `d0670431042246e19f19492d5c8068e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:27.151821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-638ddbee-9ec0-4f2a-8e0e-f9b90289891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.155998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:27.160090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.255133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1093/2139] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:27.288204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1047/2140] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:27.295641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.296065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.296508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.303562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.305756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.327786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:27.330218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.341733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1094/2141] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:27.348307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.351611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:27.367481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677499-ad84-498b-9dc1-d4eae1346a67 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.373162 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.374305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.374605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.374879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.375537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:27.375955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.379648 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.397337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1095/2142] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:27.401255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.405526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1218057-949b-4c27-ba0d-de9d12ce2a6d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.411147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.412420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.413109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.413761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.417906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1dbe2-86eb-4304-85ed-1d8b229570b4 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.425688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.427404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.427660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.428396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.428832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.429120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.429909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.432411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.443663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1048/2143] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:27.462024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.464414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.486725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1096/2144] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:27.490368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1238ce6-9823-4e0e-8a4d-b4c4c70a8b9b service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.492022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.502464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:27.576021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800e33-90c7-43bf-a31d-1139a0534692 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.581954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.582582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.582858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.583127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.583769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.585739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.604453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.605136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.605415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.605687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] PATH_INFO: `/v3/users/d0670431042246e19f19492d5c8068e5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.607832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0670431042246e19f19492d5c8068e5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.609809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.620613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1097/2145] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:27.625705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.640068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df46e6-1d36-444d-a72f-c2463af978e2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.647897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.648754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.649321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.649594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.650242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.651876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.672607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1098/2146] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:27.674814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.686307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb1cd-295d-4e73-8001-ac656e0bab4c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.699078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0670431042246e19f19492d5c8068e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.704924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.707216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.709086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.709605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.710768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.715712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0670431042246e19f19492d5c8068e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.716412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.716927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0670431042246e19f19492d5c8068e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.718966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0670431042246e19f19492d5c8068e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.729221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14682ce4-02c2-4436-8493-9cd1f4eb7886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0670431042246e19f19492d5c8068e5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:27.734076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1099/2147] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:27.738470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.740364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.751293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1049/2148] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:27 2022] DELETE /identity/v3/users/d0670431042246e19f19492d5c8068e5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:27.769020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf09801-33b4-403a-826e-aeb972dabdb9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:27.773452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.773744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.774186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.817230 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:27.818676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.865738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73323dcc-f15a-43b6-9554-a0a4a32cdbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:27.869754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323dcc-f15a-43b6-9554-a0a4a32cdbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.871017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323dcc-f15a-43b6-9554-a0a4a32cdbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.871996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323dcc-f15a-43b6-9554-a0a4a32cdbe9 admin admin] PATH_INFO: `/v3/projects/582e0c528b874adeb7f371b63ce83e84/users/9c1c8d6713994d9fae10ab1e836d04ef/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.905473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73323dcc-f15a-43b6-9554-a0a4a32cdbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582e0c528b874adeb7f371b63ce83e84, user_id=9c1c8d6713994d9fae10ab1e836d04ef, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:27.913437 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73323dcc-f15a-43b6-9554-a0a4a32cdbe9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:27.930527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1100/2149] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:27 2022] PUT /identity/v3/projects/582e0c528b874adeb7f371b63ce83e84/users/9c1c8d6713994d9fae10ab1e836d04ef/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:27.933007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1050/2150] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:27.942758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:27.943125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:27.943494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:27.945748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:27.948164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.980449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] MFA Rules not processed for user `9c1c8d6713994d9fae10ab1e836d04ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:27.982292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:27.993715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:28.045211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:28.088670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dcbec-09c7-49d7-a73e-73a0488471fa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.142847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1101/2151] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:28.143776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:28.174649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.174952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.176780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.176780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.244640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3dd55-255e-4af9-9ca6-f30422781eec None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.257550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.260464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.261263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.261542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.261810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.262445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.267201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.271621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.309801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1051/2152] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:28.348134 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1102/2153] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:28 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:28.352353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:28.367983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129913d-7b38-4d19-aa69-5003db9027db service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.452407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.453149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.453401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.455575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.456809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.459447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.517737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:28.534185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1052/2154] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:28 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:28.536082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42115782-5413-4cba-b4fb-3670e3c4a85c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.551079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.551703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.552040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.552316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.553271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.554879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.584674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1103/2155] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:28.589855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:28.616159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18bfac-552d-42fa-b4d3-37ee1f457120 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.629013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.630000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.630486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.630972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] PATH_INFO: `/v3/projects/db23880f3d7a47c3940618a0ff25035a/users/5083e76ff376472bbabc076e0549b674/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.662572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db23880f3d7a47c3940618a0ff25035a, user_id=5083e76ff376472bbabc076e0549b674, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.666486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.693018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1053/2156] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:28 2022] PUT /identity/v3/projects/db23880f3d7a47c3940618a0ff25035a/users/5083e76ff376472bbabc076e0549b674/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:28.697700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:28.709137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e96d6-257b-4fa1-bbf9-cb6efc0171f3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.789748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777fa19-a85e-4930-84ee-a87ed01c4f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.790372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777fa19-a85e-4930-84ee-a87ed01c4f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.790647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777fa19-a85e-4930-84ee-a87ed01c4f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.790919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777fa19-a85e-4930-84ee-a87ed01c4f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.791572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777fa19-a85e-4930-84ee-a87ed01c4f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.793433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777fa19-a85e-4930-84ee-a87ed01c4f20 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.805371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1104/2157] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:28.809082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:28.817103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:28.822401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d17be-1695-441b-9799-274e89948be2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:28.829581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:28.830643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.831623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.831970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] PATH_INFO: `/v3/projects/db23880f3d7a47c3940618a0ff25035a/users/5083e76ff376472bbabc076e0549b674/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.834098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db23880f3d7a47c3940618a0ff25035a, user_id=5083e76ff376472bbabc076e0549b674, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:28.837367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:28.849515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1054/2158] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:28 2022] PUT /identity/v3/projects/db23880f3d7a47c3940618a0ff25035a/users/5083e76ff376472bbabc076e0549b674/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:28.860077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:28.861152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:28.861749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:28.898878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] MFA Rules not processed for user `5083e76ff376472bbabc076e0549b674`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:28.900293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:28.909740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:28.994751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1105/2159] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:29.007518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.009410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:29.069644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.071150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:29.133552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61eb86-be7d-4168-ac24-2ff5271f1458 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.138031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ae6cd-d1d4-45df-846f-dca3e02222c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.138641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ae6cd-d1d4-45df-846f-dca3e02222c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.138914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ae6cd-d1d4-45df-846f-dca3e02222c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.139178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ae6cd-d1d4-45df-846f-dca3e02222c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.169019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32df1cf-bdf2-4265-938a-d41309aaad78 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.175739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.177180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.177458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.177787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] PATH_INFO: `/v3/projects/523c39fd62aa49588f00962dcdc13384` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.179092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] RBAC: Authorizing `identity:delete_project(project_id=523c39fd62aa49588f00962dcdc13384)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.181456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.200084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ae6cd-d1d4-45df-846f-dca3e02222c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.201818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ae6cd-d1d4-45df-846f-dca3e02222c1 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.213568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1055/2160] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:29.245894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523c39fd62aa49588f00962dcdc13384', 'request_id': 'req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:29.253249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523c39fd62aa49588f00962dcdc13384', 'request_id': 'req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:29.263787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523c39fd62aa49588f00962dcdc13384', 'request_id': 'req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:29.283139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] The token cache is being invalidate because project 523c39fd62aa49588f00962dcdc13384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:29.283645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:29.285040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7f4a71f8-c7b1-4350-a3ed-8cc01e51957a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:29.289332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1106/2161] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:29 2022] DELETE /identity/v3/projects/523c39fd62aa49588f00962dcdc13384 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:29.294872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.295161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.296047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.336624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:29.338968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:29.462907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1056/2162] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:29.464636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.464987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.465866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.525939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:29.536126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:29.565323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1107/2163] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:29.570785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.583546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd318c-3b77-4c68-bb0f-96fa6884e39a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.590305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.591154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.592553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.593509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.595606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:29.596598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.600900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.626244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.632361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1057/2164] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:29.637905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9b2b-da04-435c-8f7c-b9710317f5d4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.645490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.647490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.647869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.649765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.650546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.653256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.744664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.750413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1108/2165] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:29 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:29.758225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20582d3-b711-4d39-9b15-5f857aeb0f88 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.825961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:29.874846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.875404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.875776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.877109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.877748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.879840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.909772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1058/2166] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:29 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:29.911248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.918063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:29.922357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038dec-4396-463b-b688-50f158b08da7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.933328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.934319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.934949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.935279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.936015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.937826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.948883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1109/2167] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:29.952960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:29.964666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c921c-e8a2-46e9-94a4-3d93035a7ab9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:29.969360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbeb0-8d39-4add-a22b-4986b1db691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:29.970692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbeb0-8d39-4add-a22b-4986b1db691a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:29.970965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbeb0-8d39-4add-a22b-4986b1db691a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:29.971296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbeb0-8d39-4add-a22b-4986b1db691a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:29.971970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fbeb0-8d39-4add-a22b-4986b1db691a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:29.973681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fbeb0-8d39-4add-a22b-4986b1db691a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:29.986049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1059/2168] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:29.990836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:30.003539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df519-54b4-49e3-b1e1-981f5719c81a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:30.008269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:30.008948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.009221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.009488 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] PATH_INFO: `/v3/projects/2d771b488151423ab3f1f78a7d516934/users/e9f3b8598322494d829cb2190aef6a04/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.026709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d771b488151423ab3f1f78a7d516934, user_id=e9f3b8598322494d829cb2190aef6a04, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:30.029555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:30.048825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1110/2169] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:29 2022] PUT /identity/v3/projects/2d771b488151423ab3f1f78a7d516934/users/e9f3b8598322494d829cb2190aef6a04/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:30.059324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.059678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.060040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.088949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] MFA Rules not processed for user `e9f3b8598322494d829cb2190aef6a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:30.090172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:30.172399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1060/2170] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:30.184431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:30.186261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:30.260923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960a8c3-5e06-4b77-9318-e8045a24177f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:30.265743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d1d17-23c6-45fa-a57d-5c68985eb33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:30.266499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d1d17-23c6-45fa-a57d-5c68985eb33b service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.267374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d1d17-23c6-45fa-a57d-5c68985eb33b service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.267871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d1d17-23c6-45fa-a57d-5c68985eb33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.280390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d1d17-23c6-45fa-a57d-5c68985eb33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:30.281764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d1d17-23c6-45fa-a57d-5c68985eb33b service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:30.308452 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1111/2171] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:30.330530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:30.429611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73c10f-5a1f-409a-9502-d049808aa9f5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:30.434317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:30.435042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.435469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.435961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] PATH_INFO: `/v3/users/e9f3b8598322494d829cb2190aef6a04` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.438060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f3b8598322494d829cb2190aef6a04)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:30.440443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:30.497207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:30.499692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f3b8598322494d829cb2190aef6a04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:30.511218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f3b8598322494d829cb2190aef6a04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:30.512851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f3b8598322494d829cb2190aef6a04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:30.513702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f3b8598322494d829cb2190aef6a04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:30.524436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f3b8598322494d829cb2190aef6a04'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:30.542951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1061/2172] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:30 2022] DELETE /identity/v3/users/e9f3b8598322494d829cb2190aef6a04 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:30.547523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.548442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.548839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.568151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:30.569492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:30.632086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1112/2173] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:30.641222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:30.643453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:30.705471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4b545-9a14-4675-8a11-d214de991429 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:30.709169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:30.709780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.710056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.710327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.720633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:30.722102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:30.732056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1062/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:30.855384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:30.857167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:30.933088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c91e-a5a5-41cf-a9bb-4c8b18924322 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:30.937379 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:30.937988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:30.939073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:30.939402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:30.941581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:30.980898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:31.029832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.031269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72349725-d32e-4948-9ee3-9a783e054ca4 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.041390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1113/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:31.272503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.274326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:31.299256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50bc19-fccb-4d73-9e1d-7bafe4cb43a0 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.305395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.306137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.306485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.306825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] PATH_INFO: `/v3/projects/2d771b488151423ab3f1f78a7d516934` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.308048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d771b488151423ab3f1f78a7d516934)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.310678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.365547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d771b488151423ab3f1f78a7d516934', 'request_id': 'req-3d599a7e-c749-4ba9-9681-a2caab8dd586'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:31.371368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d771b488151423ab3f1f78a7d516934', 'request_id': 'req-3d599a7e-c749-4ba9-9681-a2caab8dd586'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:31.379700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d771b488151423ab3f1f78a7d516934', 'request_id': 'req-3d599a7e-c749-4ba9-9681-a2caab8dd586'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:31.391044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] The token cache is being invalidate because project 2d771b488151423ab3f1f78a7d516934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:31.391369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:31.392113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d599a7e-c749-4ba9-9681-a2caab8dd586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:31.393636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1063/2176] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:31 2022] DELETE /identity/v3/projects/2d771b488151423ab3f1f78a7d516934 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:31.398568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.399049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.399142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.418888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:31.420094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:31.488508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1114/2177] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:31.490517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.490800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.491076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.510795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:31.511993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:31.519952 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1064/2178] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:31.524213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.534622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7786e3e-682f-438f-914c-fdf3ea40e78f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.539236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.539818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.540095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.540368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.541049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:31.541353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.542941 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.554989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1115/2179] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:31.559130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.569094 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ef3d0-4884-4787-9bf9-853a5caa44eb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.573828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.574418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.574698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.574970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.575603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.577573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.604312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1065/2180] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:31 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:31.608399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.619647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c7d9b-3d0c-4176-aa64-d27234b19364 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.678984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.679585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.679860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.680129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.680775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.682711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.703928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1116/2181] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:31 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:31.708131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.718732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f2ea-4363-4679-9eb7-3bdbdbeeaea5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.723519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.724108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.724383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.724693 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.725331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.726910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.737439 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1066/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:31.741266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.752197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bfe57-4a7e-4c93-8745-e8c186d7962e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.757171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa9c5c-3f1c-4c56-8932-95267d11fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.757785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9c5c-3f1c-4c56-8932-95267d11fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.758055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9c5c-3f1c-4c56-8932-95267d11fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.758344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9c5c-3f1c-4c56-8932-95267d11fec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.758986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa9c5c-3f1c-4c56-8932-95267d11fec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.760630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa9c5c-3f1c-4c56-8932-95267d11fec5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.771393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1117/2183] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:31.775447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.786225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb4c0d-ffe1-4fd8-b034-47aa61a8219f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.790892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.791593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.791872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.792145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] PATH_INFO: `/v3/projects/a5672187da684e4996513fc0bc54a870/users/bd00e592a3c447a288e870e3e79ea982/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.794445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:31.810428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5672187da684e4996513fc0bc54a870, user_id=bd00e592a3c447a288e870e3e79ea982, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.813156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:31.825414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1067/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:31 2022] PUT /identity/v3/projects/a5672187da684e4996513fc0bc54a870/users/bd00e592a3c447a288e870e3e79ea982/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:31.830508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.830793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.831118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.850265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:31.851470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:31.876125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:31.913533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1118/2185] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:31.923680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:31.925428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:31.983202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be80153-391d-4586-9622-cefe22fb19a3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:31.987939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d6066-97e6-401e-a4e9-ccc8dba0cf00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:31.988544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6066-97e6-401e-a4e9-ccc8dba0cf00 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:31.988848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6066-97e6-401e-a4e9-ccc8dba0cf00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:31.989116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6066-97e6-401e-a4e9-ccc8dba0cf00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:31.998441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d6066-97e6-401e-a4e9-ccc8dba0cf00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:31.999890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d6066-97e6-401e-a4e9-ccc8dba0cf00 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:32.010033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1068/2186] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:36.174675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:36.176133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:36.190782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f74301-ec12-4f3e-9ecd-f841d5d26e03 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:36.196096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:36.196912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:36.197340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:36.197673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] PATH_INFO: `/v3/users/9c1c8d6713994d9fae10ab1e836d04ef` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:36.198992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1c8d6713994d9fae10ab1e836d04ef)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:36.202889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:36.263085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1c8d6713994d9fae10ab1e836d04ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:36.273207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1c8d6713994d9fae10ab1e836d04ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:36.274325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1c8d6713994d9fae10ab1e836d04ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:36.275302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1c8d6713994d9fae10ab1e836d04ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:36.289060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1c8d6713994d9fae10ab1e836d04ef'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:36.322545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1119/2187] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:36 2022] DELETE /identity/v3/users/9c1c8d6713994d9fae10ab1e836d04ef => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:36.327083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363696c-76d0-4c24-a1ce-304e90b47ced None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:36.327566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363696c-76d0-4c24-a1ce-304e90b47ced None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:36.327846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363696c-76d0-4c24-a1ce-304e90b47ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:36.348962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7363696c-76d0-4c24-a1ce-304e90b47ced None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:36.350201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7363696c-76d0-4c24-a1ce-304e90b47ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:36.431669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1069/2188] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:36.495753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:36.497389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:36.621520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c8b0-f68e-4139-b8f6-7925e40c31b3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:36.630417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:36.632978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:36.634130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:36.634410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:36.674018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:36.674018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:36.694387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1120/2189] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:37.105588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956719-0981-4590-ae14-c36eea861daf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.105967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956719-0981-4590-ae14-c36eea861daf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.106392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b956719-0981-4590-ae14-c36eea861daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.152127 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0b956719-0981-4590-ae14-c36eea861daf None None] MFA Rules not processed for user `bd00e592a3c447a288e870e3e79ea982`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:37.153394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0b956719-0981-4590-ae14-c36eea861daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.239726 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1070/2190] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:37.244253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.245930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.263575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3e8c-d960-40f7-9814-4c721e2aa0ec service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.270994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.272798 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.273424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.273897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.275486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.278343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.324188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1121/2191] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:37 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:37.328501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b956719-0981-4590-ae14-c36eea861daf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.349085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b956719-0981-4590-ae14-c36eea861daf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.385675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:37.397557 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.403901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.443057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:37.463203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.463848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.464257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.465232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.466045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.469796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.494144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115511-f024-430d-b02e-c8d5724089b3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.498754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1071/2192] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:37 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:37.503075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.503582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.503737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.504143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.504348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] PATH_INFO: `/v3/projects/582e0c528b874adeb7f371b63ce83e84` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.505774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=582e0c528b874adeb7f371b63ce83e84)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.507782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.515206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6b1e3-1953-48a5-abef-9db2a497cac6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.520099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.520741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.521016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.521285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.522557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.524449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.536279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1072/2193] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:37.540461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.552246 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0287f-84a8-44e2-8bc4-ee15999f2075 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.559390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.560327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.560327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.562146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] PATH_INFO: `/v3/projects/9629dfbe6bc14b9dab7316c05add2769/users/27714921a34846e6a15c0a0c1c2231cd/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.578358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582e0c528b874adeb7f371b63ce83e84', 'request_id': 'req-f598750f-c308-42c1-a73a-7c1e91065dcd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.588554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9629dfbe6bc14b9dab7316c05add2769, user_id=27714921a34846e6a15c0a0c1c2231cd, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.589739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582e0c528b874adeb7f371b63ce83e84', 'request_id': 'req-f598750f-c308-42c1-a73a-7c1e91065dcd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.591462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.603075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582e0c528b874adeb7f371b63ce83e84', 'request_id': 'req-f598750f-c308-42c1-a73a-7c1e91065dcd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.614365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1073/2194] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:37 2022] PUT /identity/v3/projects/9629dfbe6bc14b9dab7316c05add2769/users/27714921a34846e6a15c0a0c1c2231cd/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:37.616905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.620538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] The token cache is being invalidate because project 582e0c528b874adeb7f371b63ce83e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:37.620983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.621866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.623447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1122/2195] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:37 2022] DELETE /identity/v3/projects/582e0c528b874adeb7f371b63ce83e84 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:37.628828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.631411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.779972 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f87d0-0615-496c-ab38-43e5915ecbfb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.786851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.787582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.787740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.788011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.788723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.796698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.820521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1074/2196] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:37.821823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.823620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.828199 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598750f-c308-42c1-a73a-7c1e91065dcd admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.834913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.835828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.836221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.836527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] PATH_INFO: `/v3/users/5083e76ff376472bbabc076e0549b674` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.837853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8d9f4-8828-4d54-9298-4312ebd42cb5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.840022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5083e76ff376472bbabc076e0549b674)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.843036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.843702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.843981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.844253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] PATH_INFO: `/v3/projects/9629dfbe6bc14b9dab7316c05add2769/users/27714921a34846e6a15c0a0c1c2231cd/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.846816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.850814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9629dfbe6bc14b9dab7316c05add2769, user_id=27714921a34846e6a15c0a0c1c2231cd, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.857717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.877844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1075/2197] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:37 2022] PUT /identity/v3/projects/9629dfbe6bc14b9dab7316c05add2769/users/27714921a34846e6a15c0a0c1c2231cd/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:37.936909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5083e76ff376472bbabc076e0549b674'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.949390 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:37.952513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5083e76ff376472bbabc076e0549b674'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.954455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5083e76ff376472bbabc076e0549b674'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.955968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5083e76ff376472bbabc076e0549b674'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.967480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-43ce45c7-987f-457e-a528-e6b69f6b29e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5083e76ff376472bbabc076e0549b674'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.004835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1123/2198] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:37 2022] DELETE /identity/v3/users/5083e76ff376472bbabc076e0549b674 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:38.448324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:38.451574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:38.562261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:38.604025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4665e-6a07-4cbe-9be0-8d7655e2b8f2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:38.738051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:38.738720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:38.738997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:38.739269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] PATH_INFO: `/v3/projects/db23880f3d7a47c3940618a0ff25035a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:38.743937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db23880f3d7a47c3940618a0ff25035a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:38.765536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:38.871300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db23880f3d7a47c3940618a0ff25035a', 'request_id': 'req-ba832437-8db3-4f2f-adda-4209dbc27c79'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.880316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db23880f3d7a47c3940618a0ff25035a', 'request_id': 'req-ba832437-8db3-4f2f-adda-4209dbc27c79'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.898377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db23880f3d7a47c3940618a0ff25035a', 'request_id': 'req-ba832437-8db3-4f2f-adda-4209dbc27c79'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.918772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] The token cache is being invalidate because project db23880f3d7a47c3940618a0ff25035a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:38.919089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.919747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ba832437-8db3-4f2f-adda-4209dbc27c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.923130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1076/2199] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:38 2022] DELETE /identity/v3/projects/db23880f3d7a47c3940618a0ff25035a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:38.928434 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:38.929546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:38.930192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:38.971608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:38.972883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:39.089562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1124/2200] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:39.098165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.098763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.099132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.133838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:39.136539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:39.158489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.159423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1077/2201] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:39.175283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb7baa-ba6c-4517-a966-78d52726e264 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.204865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.205558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.205924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.206256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.207064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:39.207438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.209308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.232336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1125/2202] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:39.237117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.258360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a063-471d-4151-b8af-33f68cc5a1ee None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.267678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.268320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.268702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.268946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.269727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.272033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.320353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1078/2203] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:39.324708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.335578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28b20-b32f-4614-9245-b693162f9ec6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.417110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.417833 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.418985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.419489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.420866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.425114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.453725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1126/2204] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:39.455390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.469909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad369b-11d6-4ab9-9e09-6de33f14b743 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.478987 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.479783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.480151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.480481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.481214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.483746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.496679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1079/2205] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:39.500453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.511942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90e96f-fa9c-4b5a-904c-e9b0ae5e3c39 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.517549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6af44-b284-4303-87cd-29239ce7d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.518239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6af44-b284-4303-87cd-29239ce7d5da admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.518531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6af44-b284-4303-87cd-29239ce7d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.518774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6af44-b284-4303-87cd-29239ce7d5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.519417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6af44-b284-4303-87cd-29239ce7d5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.521044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6af44-b284-4303-87cd-29239ce7d5da admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.537154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1127/2206] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:39.540825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.552431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ea10-c178-4da9-80d4-cfc5a6f11c09 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.557183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.557833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.558109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.558384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] PATH_INFO: `/v3/projects/346ce4a6eecf451998f4650130ae9ab6/users/59a3c07a90df4e2f9ef47ef3aaf50580/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.575430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=346ce4a6eecf451998f4650130ae9ab6, user_id=59a3c07a90df4e2f9ef47ef3aaf50580, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.578161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.594781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1080/2207] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:39 2022] PUT /identity/v3/projects/346ce4a6eecf451998f4650130ae9ab6/users/59a3c07a90df4e2f9ef47ef3aaf50580/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:39.605929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.606212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.606490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.652275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] MFA Rules not processed for user `59a3c07a90df4e2f9ef47ef3aaf50580`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:39.653465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:39.698308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:39.770185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1128/2208] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:39.775091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.906671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:39.986481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f04485-6b61-40c2-8457-2eef85af8f3b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.991556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.992122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.992400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.992720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.993350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.995270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.029910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1081/2209] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:40.035393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.054554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e286-1b93-4b27-abae-98553c5df305 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:40.153122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:40.154105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.154493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.154887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.156043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:40.166501 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.223430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1129/2210] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:40 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:40.227217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.251097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7b777-df96-4289-8ddb-1cb957d04085 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:40.265379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:40.266413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.267221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.268891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.271652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:40.278683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.308495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1082/2211] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:40.310223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.325255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14c0a-1620-49cc-9477-3914d416dd3e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:40.339931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42b96a-2120-4239-bf6c-d45901e8f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:40.341391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42b96a-2120-4239-bf6c-d45901e8f337 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.341852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42b96a-2120-4239-bf6c-d45901e8f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.342244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42b96a-2120-4239-bf6c-d45901e8f337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.342999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42b96a-2120-4239-bf6c-d45901e8f337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:40.347368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42b96a-2120-4239-bf6c-d45901e8f337 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.377581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1130/2212] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:40.378837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.396597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497408-dfa4-4265-957f-b7a94a29e624 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:40.443627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:40.444817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.445218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.445724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] PATH_INFO: `/v3/projects/f7a4172311fc4e4a909f778aa7b64801/users/8530b8ded99747ccb95a2f4596f558d1/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.471927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a4172311fc4e4a909f778aa7b64801, user_id=8530b8ded99747ccb95a2f4596f558d1, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:40.478623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.518828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1083/2213] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:40 2022] PUT /identity/v3/projects/f7a4172311fc4e4a909f778aa7b64801/users/8530b8ded99747ccb95a2f4596f558d1/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:40.529150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.529914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.530766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.573915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] MFA Rules not processed for user `8530b8ded99747ccb95a2f4596f558d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:40.575195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:40.697211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1131/2214] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:40.701604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.833501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa6557-c633-4f88-94d9-f2d6561be8d6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:40.850524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:40.851774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.852083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.852355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.853624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:40.856377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.933420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1084/2215] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:40 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:40.938477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.951731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5efa9e-81a1-4d4c-ab65-e885f4b55c22 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:41.029520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:41.082953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:41.083752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.084129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.085240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.086003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:41.088395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:41.125763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1132/2216] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:40 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:41.130509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:41.147584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07999c2-b672-4ebc-bf50-14185c547e2b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:41.159612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:41.160205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.160479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.160775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.161689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:41.163589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:41.178782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1085/2217] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:41.183887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:41.200745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310728e3-6083-4cf0-9193-c35db1c28784 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:41.215120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:41.215954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.216271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.216547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] PATH_INFO: `/v3/projects/fde25613f7c0408ab88ea6a2e363f782/users/063f089f5ace4a92927a39990ff6993b/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.252732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde25613f7c0408ab88ea6a2e363f782, user_id=063f089f5ace4a92927a39990ff6993b, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:41.255662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:41.287708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1133/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:41 2022] PUT /identity/v3/projects/fde25613f7c0408ab88ea6a2e363f782/users/063f089f5ace4a92927a39990ff6993b/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:41.293660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:41.310887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c703d-55b9-4099-b99b-45eaba75be34 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:41.385077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:41.400338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec91b6-4ab3-413b-8bf6-ccb931361c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:41.401104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec91b6-4ab3-413b-8bf6-ccb931361c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.401448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec91b6-4ab3-413b-8bf6-ccb931361c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.402199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec91b6-4ab3-413b-8bf6-ccb931361c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.402542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec91b6-4ab3-413b-8bf6-ccb931361c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:41.404215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec91b6-4ab3-413b-8bf6-ccb931361c1c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:41.422265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:41.422994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1086/2219] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:41.434847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f61df-7924-4d9f-bd78-4063e2a56338 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:41.441623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:41.442463 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.442793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.443260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] PATH_INFO: `/v3/projects/fde25613f7c0408ab88ea6a2e363f782/users/063f089f5ace4a92927a39990ff6993b/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.445497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde25613f7c0408ab88ea6a2e363f782, user_id=063f089f5ace4a92927a39990ff6993b, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:41.448400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:41.468616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1134/2220] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:41 2022] PUT /identity/v3/projects/fde25613f7c0408ab88ea6a2e363f782/users/063f089f5ace4a92927a39990ff6993b/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:41.481118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.481563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.481642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.539193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] MFA Rules not processed for user `063f089f5ace4a92927a39990ff6993b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:41.540896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:41.648642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1087/2221] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:41.661727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:41.663453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:41.772880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7cd0d-3c65-401f-898c-0f69ce540db0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:41.778530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:41.779768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:41.780229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:41.780810 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:41.798404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:41.800190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:41.830567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1135/2222] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:42.308480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:42.310216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:42.561508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfd3a6-c0db-4e05-89ea-f097c95eb46c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:42.592618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:42.593901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:42.594618 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:42.595689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] PATH_INFO: `/v3/users/0ea25f4c603748d9a3c16e23c8c97d0d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:42.597762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea25f4c603748d9a3c16e23c8c97d0d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:42.600935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:42.757862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea25f4c603748d9a3c16e23c8c97d0d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:42.771351 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea25f4c603748d9a3c16e23c8c97d0d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:42.771989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea25f4c603748d9a3c16e23c8c97d0d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:42.772684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea25f4c603748d9a3c16e23c8c97d0d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:42.785986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c9c913af-438d-4bd0-8c07-5c44d3b23b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea25f4c603748d9a3c16e23c8c97d0d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:42.812460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:42.820223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:42.830030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1088/2223] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:42 2022] DELETE /identity/v3/users/0ea25f4c603748d9a3c16e23c8c97d0d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:42.832246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db0807-efd5-4e4b-92ca-19f3fc3548b6 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:42.834223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:42.834505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:42.834778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:42.864689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:42.865933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:42.949686 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:42.950288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:42.950563 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:42.950827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:42.959259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:42.997421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1089/2224] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:43.005460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:43.007019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:43.108264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:43.154252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:43.163021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:43.177184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c21ae4-aa4b-4979-9208-35f27d4b9b79 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:43.184609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1136/2225] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:43.190347 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530d5d-8a12-4836-b865-09a8f32b14b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:43.190965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530d5d-8a12-4836-b865-09a8f32b14b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:43.191249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530d5d-8a12-4836-b865-09a8f32b14b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:43.191522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530d5d-8a12-4836-b865-09a8f32b14b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:43.214658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530d5d-8a12-4836-b865-09a8f32b14b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:43.216288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530d5d-8a12-4836-b865-09a8f32b14b5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:43.251007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1090/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:43.884815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:43.886304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:43.924907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d377a-c102-4681-8633-3e5160a86b8a service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:43.941818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:43.942617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:43.942969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:43.943322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] PATH_INFO: `/v3/projects/e71e8e13080644198758cf0085780c48` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:43.945185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71e8e13080644198758cf0085780c48)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:43.947497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:44.015465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71e8e13080644198758cf0085780c48', 'request_id': 'req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:44.021968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71e8e13080644198758cf0085780c48', 'request_id': 'req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:44.031043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71e8e13080644198758cf0085780c48', 'request_id': 'req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:44.043302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] The token cache is being invalidate because project e71e8e13080644198758cf0085780c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:44.043544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:44.044204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:44.048646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1137/2227] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:43 2022] DELETE /identity/v3/projects/e71e8e13080644198758cf0085780c48 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:45.903629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560105-7e12-4eb8-af2a-d186b90c5b3f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:45.904124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560105-7e12-4eb8-af2a-d186b90c5b3f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:45.904204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560105-7e12-4eb8-af2a-d186b90c5b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:45.934870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-63560105-7e12-4eb8-af2a-d186b90c5b3f None None] MFA Rules not processed for user `27714921a34846e6a15c0a0c1c2231cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:45.936130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-63560105-7e12-4eb8-af2a-d186b90c5b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:46.007564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1091/2228] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:46.021926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:46.024264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:46.145583 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3bfcc-c4eb-4c59-a9ad-74128f32ceac admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:46.150154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:46.150864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:46.151213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:46.151558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:46.153945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:46.262202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:46.263811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:46.296819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1138/2229] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:46.543613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b3ce3-9ce5-4023-b104-8753dcce310e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:46.544247 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b3ce3-9ce5-4023-b104-8753dcce310e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:46.544743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b3ce3-9ce5-4023-b104-8753dcce310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:46.608481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5f5b3ce3-9ce5-4023-b104-8753dcce310e None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:46.609818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5f5b3ce3-9ce5-4023-b104-8753dcce310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:46.661062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:46.777454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1092/2230] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:46.841321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:46.847443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:46.852848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:46.923208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:46.923783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:46.923783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:46.967221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:46.969859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:46.986857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1093/2231] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:46.987605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e70ad-aef2-48ed-9e1c-f711b5b27148 service glance] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:46.997228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:46.997993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:46.998275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:46.998539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:46.998783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:47.008114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:47.009785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:47.020875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1139/2232] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:21:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:21:47.026572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ff6b5-f91d-4265-9796-b0e162e2cd05 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:47.032113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9f7ad-2444-4d72-b0c4-2bd1e25a0182 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:47.033840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9f7ad-2444-4d72-b0c4-2bd1e25a0182 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:47.034283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9f7ad-2444-4d72-b0c4-2bd1e25a0182 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:47.034559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9f7ad-2444-4d72-b0c4-2bd1e25a0182 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:47.047788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9f7ad-2444-4d72-b0c4-2bd1e25a0182 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:47.052027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9f7ad-2444-4d72-b0c4-2bd1e25a0182 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:47.061336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1094/2233] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:21:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:21:48.242438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:48.244071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:48.353601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:48.354430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:48.354862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:48.390156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cbf2-fb9d-4cac-93af-4af9b04504dc service swift] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:48.395242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:48.395859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:48.396135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:48.396596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:48.398959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:48.404389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:48.405870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:48.425878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1095/2234] 10.222.0.25 () {58 vars in 967 bytes} [Sun Aug 7 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:48.446418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:48.481959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e7cb-29c6-49fc-9144-419c9944f082 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:48.490498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c55c8a-07f5-409b-a876-5cff2d841741 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:48.491366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c55c8a-07f5-409b-a876-5cff2d841741 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:48.492491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c55c8a-07f5-409b-a876-5cff2d841741 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:48.492956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c55c8a-07f5-409b-a876-5cff2d841741 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:48.510357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c55c8a-07f5-409b-a876-5cff2d841741 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:48.512937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c55c8a-07f5-409b-a876-5cff2d841741 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:48.536331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:48.537164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1096/2235] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:21:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:21:48.538662 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:48.553032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1140/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:49.070391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f335-2289-454f-afdf-980023636899 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:49.072470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f335-2289-454f-afdf-980023636899 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:49.072951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f335-2289-454f-afdf-980023636899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:49.124677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f575f335-2289-454f-afdf-980023636899 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:49.126733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f575f335-2289-454f-afdf-980023636899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:49.135744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1097/2237] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:49.159580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:49.185122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb809-4914-4630-b259-0ed57cce83ca service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:49.198440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:49.199300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:49.199581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:49.202185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:49.221262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:49.227727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:49.257363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1141/2238] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:21:49.985319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:49.985319 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:49.985887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:50.029342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:50.031066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:50.056182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1098/2239] 10.222.0.25 () {58 vars in 967 bytes} [Sun Aug 7 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:50.087146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:50.108487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85c707-7159-4527-8eae-d303f8b85a7d service swift] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:50.127033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b075-1094-44c9-9358-2fa13f7c2ef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:50.127657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b075-1094-44c9-9358-2fa13f7c2ef1 service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:50.127935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b075-1094-44c9-9358-2fa13f7c2ef1 service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:50.128203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b075-1094-44c9-9358-2fa13f7c2ef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:50.160358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b075-1094-44c9-9358-2fa13f7c2ef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:50.162342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b075-1094-44c9-9358-2fa13f7c2ef1 service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:50.184002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1142/2240] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:21:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:21:51.993819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:51.995342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.085664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082b583-a85f-45d6-a157-6daaef106c23 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.090769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.091543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.091818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.092092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] PATH_INFO: `/v3/users/59a3c07a90df4e2f9ef47ef3aaf50580` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.093249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a3c07a90df4e2f9ef47ef3aaf50580)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.095514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.178659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a3c07a90df4e2f9ef47ef3aaf50580'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.187212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a3c07a90df4e2f9ef47ef3aaf50580'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.188767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a3c07a90df4e2f9ef47ef3aaf50580'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.189720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a3c07a90df4e2f9ef47ef3aaf50580'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.199082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a3c07a90df4e2f9ef47ef3aaf50580'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.209170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:52.223313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1099/2241] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:51 2022] DELETE /identity/v3/users/59a3c07a90df4e2f9ef47ef3aaf50580 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:52.230382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.230966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.230966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.258287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:52.259866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.286573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:52.362779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1143/2242] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:52.374775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.377266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.489934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391db6b-9221-475a-9edc-54ce0e4bb54b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.500871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.501814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.502394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.502394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.525725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.527336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.550341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1100/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:52.935920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.937493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.980854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc871-0db7-45e7-95a0-800aef6d426a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.987585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.988018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.988291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.988578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] PATH_INFO: `/v3/projects/346ce4a6eecf451998f4650130ae9ab6` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.989735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346ce4a6eecf451998f4650130ae9ab6)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.991988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.038479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.040479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.061024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ac656-f3b1-4c98-88d0-f4290c4fb7c5 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.086137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346ce4a6eecf451998f4650130ae9ab6', 'request_id': 'req-06072331-2c5e-4126-aa58-0e1e13854087'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.102659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346ce4a6eecf451998f4650130ae9ab6', 'request_id': 'req-06072331-2c5e-4126-aa58-0e1e13854087'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.119751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346ce4a6eecf451998f4650130ae9ab6', 'request_id': 'req-06072331-2c5e-4126-aa58-0e1e13854087'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.138509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] The token cache is being invalidate because project 346ce4a6eecf451998f4650130ae9ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:53.139079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.140099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.144881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.144881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.144881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.144881 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] PATH_INFO: `/v3/users/dda80d351ec04db6a15890546b3d2216` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.145602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1144/2244] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:52 2022] DELETE /identity/v3/projects/346ce4a6eecf451998f4650130ae9ab6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:53.146753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.147006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda80d351ec04db6a15890546b3d2216)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.149130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.149463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.164033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072331-2c5e-4126-aa58-0e1e13854087 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.169649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.170504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.170979 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.171411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] PATH_INFO: `/v3/users/8530b8ded99747ccb95a2f4596f558d1` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.173409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8530b8ded99747ccb95a2f4596f558d1)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.177776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.214533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda80d351ec04db6a15890546b3d2216'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.228458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda80d351ec04db6a15890546b3d2216'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.229128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda80d351ec04db6a15890546b3d2216'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.230607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda80d351ec04db6a15890546b3d2216'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.240605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7571ed93-a739-468c-8b0f-a29370161f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda80d351ec04db6a15890546b3d2216'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.248649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8530b8ded99747ccb95a2f4596f558d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.258014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8530b8ded99747ccb95a2f4596f558d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.258761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8530b8ded99747ccb95a2f4596f558d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.259384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8530b8ded99747ccb95a2f4596f558d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.262629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1101/2245] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:53 2022] DELETE /identity/v3/users/dda80d351ec04db6a15890546b3d2216 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:53.266694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.266974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.267252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.275735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8530b8ded99747ccb95a2f4596f558d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.311539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:53.318561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1145/2246] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:53 2022] DELETE /identity/v3/users/8530b8ded99747ccb95a2f4596f558d1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:53.318757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.326624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:53.402276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1102/2247] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:53.414786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.416874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.442407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:53.512553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ba700-b449-4181-b548-645bd6972d56 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.517664 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.518413 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.518807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.519174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.530122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.533220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.544265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1146/2248] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:53.734434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.736167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.786141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409c065-8a42-48bb-9972-2f8232e1ea3f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.793173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.793509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.793965 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.794857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.795865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] PATH_INFO: `/v3/projects/f7a4172311fc4e4a909f778aa7b64801` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.797359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a4172311fc4e4a909f778aa7b64801)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.797947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.800513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.820270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c9f80-c7e7-4f04-90dd-96cd776e08c0 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.824937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.825570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.825937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.826188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] PATH_INFO: `/v3/projects/df609b88d75f4981860be8484c6b0a79` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.828010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df609b88d75f4981860be8484c6b0a79)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.832996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.898189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a4172311fc4e4a909f778aa7b64801', 'request_id': 'req-a21fb608-6967-4390-8875-3e7d53f00fc2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.906198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a4172311fc4e4a909f778aa7b64801', 'request_id': 'req-a21fb608-6967-4390-8875-3e7d53f00fc2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.909896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df609b88d75f4981860be8484c6b0a79', 'request_id': 'req-2d546778-1860-49fa-a2be-1d2a44df2bc6'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.917247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df609b88d75f4981860be8484c6b0a79', 'request_id': 'req-2d546778-1860-49fa-a2be-1d2a44df2bc6'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.917786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a4172311fc4e4a909f778aa7b64801', 'request_id': 'req-a21fb608-6967-4390-8875-3e7d53f00fc2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.930011 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df609b88d75f4981860be8484c6b0a79', 'request_id': 'req-2d546778-1860-49fa-a2be-1d2a44df2bc6'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.934092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] The token cache is being invalidate because project f7a4172311fc4e4a909f778aa7b64801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:53.934378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.935116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.940240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1103/2249] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:53 2022] DELETE /identity/v3/projects/f7a4172311fc4e4a909f778aa7b64801 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:53.941132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.942553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.945201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] The token cache is being invalidate because project df609b88d75f4981860be8484c6b0a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:53.945525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.946210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:53.947936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1147/2250] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:53 2022] DELETE /identity/v3/projects/df609b88d75f4981860be8484c6b0a79 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:54.026586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb608-6967-4390-8875-3e7d53f00fc2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:54.088248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:54.109071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:54.110869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.111333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.111757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] PATH_INFO: `/v3/users/063f089f5ace4a92927a39990ff6993b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.113187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=063f089f5ace4a92927a39990ff6993b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:54.115332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:54.173906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063f089f5ace4a92927a39990ff6993b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.183252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063f089f5ace4a92927a39990ff6993b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.183955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063f089f5ace4a92927a39990ff6993b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.184605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063f089f5ace4a92927a39990ff6993b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.193890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5a4fb02-2ae6-438b-a2d2-18ade524b72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063f089f5ace4a92927a39990ff6993b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.212755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1104/2251] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:53 2022] DELETE /identity/v3/users/063f089f5ace4a92927a39990ff6993b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:54.563646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:54.565565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:54.611180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d546778-1860-49fa-a2be-1d2a44df2bc6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:54.681231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:54.681961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.682368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.682683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] PATH_INFO: `/v3/projects/fde25613f7c0408ab88ea6a2e363f782` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.683879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde25613f7c0408ab88ea6a2e363f782)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:54.686144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:54.742438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:54.746154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde25613f7c0408ab88ea6a2e363f782', 'request_id': 'req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.756927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde25613f7c0408ab88ea6a2e363f782', 'request_id': 'req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.767327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde25613f7c0408ab88ea6a2e363f782', 'request_id': 'req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.779911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] The token cache is being invalidate because project fde25613f7c0408ab88ea6a2e363f782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:54.780194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.780883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f272f81-8e7f-4c73-84e9-6f5c2c8a43d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.782579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1148/2252] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:54 2022] DELETE /identity/v3/projects/fde25613f7c0408ab88ea6a2e363f782 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:54.795928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.796400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.796835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.826551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:54.827943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:54.915696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.916124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.916499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.924106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1105/2253] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:54.939223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:54.940478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:54.950864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1149/2254] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:54.955751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:54.966846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439e29-b710-4ea1-a1a8-8191e7173c53 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:54.972581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:54.973212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.973501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.973767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.974418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:54.974725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:54.976321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:54.992613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1106/2255] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:54.993832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.004192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2363ff-992a-4aef-b83f-e16c8f1639a4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.008989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.009590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.009867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.010142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.010774 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.013022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.051054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1150/2256] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:54 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:55.051286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.063416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e16d9-a4b1-4efa-939d-a2c9193e5e03 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.117766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:55.135695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.136310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.136620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.139065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.139065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.139748 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.165819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1107/2257] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:55.170057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.181375 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3d59d-dcd5-4a9f-bd90-69fe747e4f17 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.186378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.187110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.187456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.188689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.189424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.191118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.202527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1151/2258] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:55.208158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.218631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee4d48-50bc-46a4-bff2-f31414430e71 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.224394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe620-545f-4f7a-9dfc-824f7cf104f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.225112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe620-545f-4f7a-9dfc-824f7cf104f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.225389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe620-545f-4f7a-9dfc-824f7cf104f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.225660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe620-545f-4f7a-9dfc-824f7cf104f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.226309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffe620-545f-4f7a-9dfc-824f7cf104f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.227933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffe620-545f-4f7a-9dfc-824f7cf104f8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.244066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1108/2259] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:55.248827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.260321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28121d-aea7-439d-855e-c9b834075f91 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.276843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.276843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.276843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.276843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] PATH_INFO: `/v3/projects/6b9b82980f4d4d359f7193edf3a97e59/users/ca0d4c189bb34547945be81c4851ca12/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.293646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9b82980f4d4d359f7193edf3a97e59, user_id=ca0d4c189bb34547945be81c4851ca12, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.296538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.323112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1152/2260] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:55 2022] PUT /identity/v3/projects/6b9b82980f4d4d359f7193edf3a97e59/users/ca0d4c189bb34547945be81c4851ca12/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:55.335740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.336305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.336599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.405397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] MFA Rules not processed for user `ca0d4c189bb34547945be81c4851ca12`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:55.407461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.482324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1109/2261] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:55.493630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.496167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.574480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb638-3f25-49ba-ba83-fb86fb929d87 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.578898 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4fe6f-3bc9-41d9-b493-3aab686652ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.579588 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4fe6f-3bc9-41d9-b493-3aab686652ec service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.579928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4fe6f-3bc9-41d9-b493-3aab686652ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.580264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4fe6f-3bc9-41d9-b493-3aab686652ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.590808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4fe6f-3bc9-41d9-b493-3aab686652ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.592526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4fe6f-3bc9-41d9-b493-3aab686652ec service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.615279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1153/2262] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:58.764928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.835576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3c6f-8a1d-4527-9ffc-d80f783429ac None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.836139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3c6f-8a1d-4527-9ffc-d80f783429ac None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.836258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3c6f-8a1d-4527-9ffc-d80f783429ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.840541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35103863-5d7f-4ad2-8dc6-1a916502c5f4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.845336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.846031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.846311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.846610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] PATH_INFO: `/v3/users/ca0d4c189bb34547945be81c4851ca12` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.847716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0d4c189bb34547945be81c4851ca12)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.849658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.855088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-09df3c6f-8a1d-4527-9ffc-d80f783429ac None None] MFA Rules not processed for user `bd00e592a3c447a288e870e3e79ea982`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:58.856276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-09df3c6f-8a1d-4527-9ffc-d80f783429ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:58.897923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0d4c189bb34547945be81c4851ca12'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.905325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0d4c189bb34547945be81c4851ca12'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.905935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0d4c189bb34547945be81c4851ca12'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.906613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0d4c189bb34547945be81c4851ca12'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.912795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:58.915021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0d4c189bb34547945be81c4851ca12'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.915861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1154/2263] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:58.935577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1110/2264] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:58 2022] DELETE /identity/v3/users/ca0d4c189bb34547945be81c4851ca12 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:58.940748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.941097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.941319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.961419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:58.962617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:58.973345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:59.028649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1155/2265] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:59.039367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.040895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.104795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37390bf-ddc9-44aa-b682-db73905f5e9b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.108484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe4c4-057b-4e4c-bc92-8b7cbc2a397c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.109119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe4c4-057b-4e4c-bc92-8b7cbc2a397c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.109462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe4c4-057b-4e4c-bc92-8b7cbc2a397c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.110369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe4c4-057b-4e4c-bc92-8b7cbc2a397c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.119679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfe4c4-057b-4e4c-bc92-8b7cbc2a397c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.121139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfe4c4-057b-4e4c-bc92-8b7cbc2a397c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.131039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1111/2266] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:59.495062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.496484 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.517972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08813-0b3d-4300-a58c-d4f21029198d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.533621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.534509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.534927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.535414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] PATH_INFO: `/v3/projects/6b9b82980f4d4d359f7193edf3a97e59` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.537124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9b82980f4d4d359f7193edf3a97e59)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.540700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.604411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9b82980f4d4d359f7193edf3a97e59', 'request_id': 'req-8ac88eba-da3a-40c5-9962-c1113b282290'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:59.613762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9b82980f4d4d359f7193edf3a97e59', 'request_id': 'req-8ac88eba-da3a-40c5-9962-c1113b282290'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:59.621741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9b82980f4d4d359f7193edf3a97e59', 'request_id': 'req-8ac88eba-da3a-40c5-9962-c1113b282290'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:59.637266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] The token cache is being invalidate because project 6b9b82980f4d4d359f7193edf3a97e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:59.637561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:59.638222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-8ac88eba-da3a-40c5-9962-c1113b282290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:59.639704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1156/2267] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:59 2022] DELETE /identity/v3/projects/6b9b82980f4d4d359f7193edf3a97e59 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:59.645757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.646104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.646572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.668789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:59.670045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.732826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1112/2268] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:59.742699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.742984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.743255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.769808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:59.771043 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.779166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1157/2269] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:59.784774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.794906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da637a5-16e8-490a-917e-d8e52f005f27 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.805626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.805626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.805626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.805626 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.806124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:59.806124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.806124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.823418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1113/2270] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:59.828078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.839727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e28c4-5f71-49f5-87b4-91b4d5420050 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.845338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.845937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.846397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.846758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.847525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.849964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.883728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1158/2271] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:59.888550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.901677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa501-93b8-4f96-a21d-146a8ffba8ab admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.972009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.972671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.972977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.973242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.973889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.975794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.992408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:00.002440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1114/2272] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:22:00.007305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.020259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617a2a5-eef9-4eaa-a766-f6ff8cc0eb1c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.026713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.027311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.027585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.027855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.028490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.030183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.042015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1159/2273] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:00.046662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.060796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eee14-d0b8-45b7-a15a-b28d8c7230d3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.066906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810aa00-0e27-4a09-ba16-bd93d9af9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.067736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810aa00-0e27-4a09-ba16-bd93d9af9dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.068177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810aa00-0e27-4a09-ba16-bd93d9af9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.068442 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810aa00-0e27-4a09-ba16-bd93d9af9dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.069117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810aa00-0e27-4a09-ba16-bd93d9af9dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.070711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810aa00-0e27-4a09-ba16-bd93d9af9dc1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.088631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1115/2274] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:00.089827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.100705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5256a99-b59b-4ffe-82bf-59cb8e26ae17 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.105540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.106216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.106493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.106764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] PATH_INFO: `/v3/projects/002d245325a747a4b1b6071e0ad7d98d/users/09fc29897fc143ec954ad49c8642a178/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.124254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=002d245325a747a4b1b6071e0ad7d98d, user_id=09fc29897fc143ec954ad49c8642a178, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.127876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.142012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1160/2275] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:00 2022] PUT /identity/v3/projects/002d245325a747a4b1b6071e0ad7d98d/users/09fc29897fc143ec954ad49c8642a178/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:00.146957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491716b-ee39-4b8c-bfea-ee3581566aea None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.147238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491716b-ee39-4b8c-bfea-ee3581566aea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.147505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491716b-ee39-4b8c-bfea-ee3581566aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.166378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f491716b-ee39-4b8c-bfea-ee3581566aea None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:00.167578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f491716b-ee39-4b8c-bfea-ee3581566aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:00.235296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1116/2276] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:00.243323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.246559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:00.289837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:00.310684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0996a-cf80-48d1-b27e-8ee1fafa8c2e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.314525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.315131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.315405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.315673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.325602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.327244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.337345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1161/2277] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:22:01.218070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6177-564d-471a-bcaf-60eb3ca8333a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:01.218621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6177-564d-471a-bcaf-60eb3ca8333a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:01.218773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6177-564d-471a-bcaf-60eb3ca8333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:01.258121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b72c6177-564d-471a-bcaf-60eb3ca8333a None None] MFA Rules not processed for user `09fc29897fc143ec954ad49c8642a178`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:01.259817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b72c6177-564d-471a-bcaf-60eb3ca8333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:01.386353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1117/2278] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:01.393095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:01.394776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:01.514460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875e10-443f-4794-ab1a-c65b36451ba3 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:01.527101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:01.528280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:01.528876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:01.529331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:01.541694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:01.543541 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:01.556846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1162/2279] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:01.760982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ecf0-f8b5-4f76-b165-437e0ae86c61 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:01.761433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ecf0-f8b5-4f76-b165-437e0ae86c61 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:01.761549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ecf0-f8b5-4f76-b165-437e0ae86c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:01.790523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3c05ecf0-f8b5-4f76-b165-437e0ae86c61 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:01.793050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3c05ecf0-f8b5-4f76-b165-437e0ae86c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:01.913118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1118/2280] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:01.928404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:01.931618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:02.060130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff64976-6922-4ded-a9d7-23aeb2c65bda service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:02.065747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42823d-e23d-44ac-9d32-a6cc5818b7dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:02.066540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42823d-e23d-44ac-9d32-a6cc5818b7dc service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:02.066984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42823d-e23d-44ac-9d32-a6cc5818b7dc service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:02.067405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42823d-e23d-44ac-9d32-a6cc5818b7dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:02.078156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42823d-e23d-44ac-9d32-a6cc5818b7dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:02.079803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42823d-e23d-44ac-9d32-a6cc5818b7dc service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:02.088538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1163/2281] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:22:03.076929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:03.077414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:03.077536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:03.102752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] MFA Rules not processed for user `09fc29897fc143ec954ad49c8642a178`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:03.104038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:03.112117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1119/2282] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:12.085410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=68 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:13.096382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:24.112112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fbc4b-70fc-4eb3-96ed-8bdedd9812d1 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:24.112815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fbc4b-70fc-4eb3-96ed-8bdedd9812d1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:24.112815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fbc4b-70fc-4eb3-96ed-8bdedd9812d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:24.131303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-cf6fbc4b-70fc-4eb3-96ed-8bdedd9812d1 None None] MFA Rules not processed for user `17943c8309fc4e97b180373b320595f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:24.132491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cf6fbc4b-70fc-4eb3-96ed-8bdedd9812d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:24.195994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1164/2283] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:34.188222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=25 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:42.895504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:42.896962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:42.910211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6509-a7c4-44f9-9f3a-d5d349568e08 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:42.913783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:42.914378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:42.914652 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:42.914920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:42.916583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:42.978736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:42.980085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b981363-e112-4b36-978f-41d695f22e2c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:42.990153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1120/2284] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:46.270114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddcccc-7fb4-49a9-85e3-fd4db142fcc9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:46.270671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddcccc-7fb4-49a9-85e3-fd4db142fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:46.270768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddcccc-7fb4-49a9-85e3-fd4db142fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:46.291710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e9ddcccc-7fb4-49a9-85e3-fd4db142fcc9 None None] MFA Rules not processed for user `09fc29897fc143ec954ad49c8642a178`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:46.293034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e9ddcccc-7fb4-49a9-85e3-fd4db142fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:46.301687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1165/2285] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:52.985329 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=30 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:56.287921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:58.412481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:58.413051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:58.413051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:58.432111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] MFA Rules not processed for user `a38be80ef1854cb3aeaa5ca40ed043f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:58.433315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:58.490788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1121/2286] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:22:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:07.409063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b0db-8470-4475-824b-d3436b018dcb None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:07.409558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b0db-8470-4475-824b-d3436b018dcb None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:07.409883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b0db-8470-4475-824b-d3436b018dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:07.429680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5e51b0db-8470-4475-824b-d3436b018dcb None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:07.430816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5e51b0db-8470-4475-824b-d3436b018dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:07.438007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1166/2287] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:23:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:23:07.480961 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:07.492525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e18f1-b23b-43c5-8e27-e75f931da2a5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:07.498854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:07.499538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:07.499813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:07.500081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:07.508102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:07.509807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:07.518257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1122/2288] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:23:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:23:17.426015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:17.514487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=31 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:22.914562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:22.915115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:22.915115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:22.934063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:22.935240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:22.942940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1167/2289] 10.222.0.25 () {58 vars in 967 bytes} [Sun Aug 7 18:23:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:22.955610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:22.966065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabdcc4-529f-4a78-9f96-3e1d8a8ef615 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:22.971018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:22.971599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:22.971872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:22.972137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:22.979945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:22.981530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:22.989732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1123/2290] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:23:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:23:24.914623 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:24.928234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657dd3b-0d52-4851-9dcc-5dff36f7c815 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:24.932725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:24.933345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:24.933636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:24.933905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] PATH_INFO: `/v3/users/09fc29897fc143ec954ad49c8642a178` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:24.935022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fc29897fc143ec954ad49c8642a178)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:24.937032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:24.983044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fc29897fc143ec954ad49c8642a178'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:24.990104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fc29897fc143ec954ad49c8642a178'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:24.990762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fc29897fc143ec954ad49c8642a178'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:24.991362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fc29897fc143ec954ad49c8642a178'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:24.998554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-32894362-4702-4951-9eed-2fbf760987c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fc29897fc143ec954ad49c8642a178'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:25.017738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1168/2291] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:23:24 2022] DELETE /identity/v3/users/09fc29897fc143ec954ad49c8642a178 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:25.193770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.206964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c1baf-663d-4859-97a6-57c483a06a22 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.268725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.269345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.269622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.269888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] PATH_INFO: `/v3/projects/002d245325a747a4b1b6071e0ad7d98d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.270976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=002d245325a747a4b1b6071e0ad7d98d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.272899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.318455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002d245325a747a4b1b6071e0ad7d98d', 'request_id': 'req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:25.323790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002d245325a747a4b1b6071e0ad7d98d', 'request_id': 'req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:25.332040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002d245325a747a4b1b6071e0ad7d98d', 'request_id': 'req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:25.342837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] The token cache is being invalidate because project 002d245325a747a4b1b6071e0ad7d98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:23:25.343120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:25.343752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6cdaca7f-9cfb-4b29-b85e-db853cf0fee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:25.346216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1124/2292] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:23:25 2022] DELETE /identity/v3/projects/002d245325a747a4b1b6071e0ad7d98d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:25.351121 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.351409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.351687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.371495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:25.372665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:25.431889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1169/2293] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:25.440819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.441108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.441380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.461433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:25.462636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:25.471142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1125/2294] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:25.476204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.486353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36969bee-d6ae-4681-b603-9dc22852ba36 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.490954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.491545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.491822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.492096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.492771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:23:25.493078 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.494666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.506048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1170/2295] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:23:25.510356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.520131 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9c92-429f-474c-84aa-10275a7bfb0f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.524810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.525397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.525674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.525943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.526580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.528463 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.555829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1126/2296] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:23:25.560116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.570495 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d761d2-e3da-4b7f-9966-6cc51cd86930 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.618169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:25.629042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.629567 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.629841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.630107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.630712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.632618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.653471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1171/2297] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:23:25 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:23:25.658476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.669341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326ba5f-268f-4421-a56a-fbb6a5cbadd7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.674099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.674683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.674955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.675221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.675846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.677462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.687138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1127/2298] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:23:25.691986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.702050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdae18-da8a-4028-9f26-0c4510faaf80 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.707620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256111-4bde-43ad-8e63-2e7cc3d4087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.708211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256111-4bde-43ad-8e63-2e7cc3d4087f admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.708491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256111-4bde-43ad-8e63-2e7cc3d4087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.708794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256111-4bde-43ad-8e63-2e7cc3d4087f admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.709428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256111-4bde-43ad-8e63-2e7cc3d4087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.711006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256111-4bde-43ad-8e63-2e7cc3d4087f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.721498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1172/2299] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:23:25.725389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.735327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fae7f-dcb2-452e-833b-9a22789ef66f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.739971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.740624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.740898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.741164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] PATH_INFO: `/v3/projects/82396eb83964499a91dfcac966e3179f/users/c07cf25358024adeb48ead31e28af57c/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.755732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82396eb83964499a91dfcac966e3179f, user_id=c07cf25358024adeb48ead31e28af57c, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.758376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.772161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1128/2300] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:23:25 2022] PUT /identity/v3/projects/82396eb83964499a91dfcac966e3179f/users/c07cf25358024adeb48ead31e28af57c/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:25.782319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.782605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.782883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.810547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] MFA Rules not processed for user `c07cf25358024adeb48ead31e28af57c`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:25.811752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:25.875176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1173/2301] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:23:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:25.887395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:25.889143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:25.903856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:25.947254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcbfc7-9e0c-43c2-9ab0-4a4041f11953 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:25.950840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4d9d-7231-4703-b99c-d7cea74f5078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:25.951436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4d9d-7231-4703-b99c-d7cea74f5078 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:25.951710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4d9d-7231-4703-b99c-d7cea74f5078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:25.951981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4d9d-7231-4703-b99c-d7cea74f5078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:25.961262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4d9d-7231-4703-b99c-d7cea74f5078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:25.962674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4d9d-7231-4703-b99c-d7cea74f5078 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:25.971259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1129/2302] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:28.525132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:28.587312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dee26-64ab-47d3-860f-bab354462100 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:28.591741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:28.592348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:28.592650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:28.592922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] PATH_INFO: `/v3/users/c07cf25358024adeb48ead31e28af57c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:28.594103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07cf25358024adeb48ead31e28af57c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:28.596968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:28.648289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07cf25358024adeb48ead31e28af57c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:28.654951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07cf25358024adeb48ead31e28af57c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:28.655609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07cf25358024adeb48ead31e28af57c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:28.656213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07cf25358024adeb48ead31e28af57c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:28.664403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07cf25358024adeb48ead31e28af57c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:28.665601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:28.683836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1174/2303] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:23:28 2022] DELETE /identity/v3/users/c07cf25358024adeb48ead31e28af57c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:28.688389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:28.689443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:28.689644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:28.708575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:28.709774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:28.766006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1130/2304] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:28.776655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:28.778137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:28.835429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ef17-bbee-4e59-864a-b8bb0b88293f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:28.839084 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c7908-829a-4f0e-ad6c-e16166d9ba6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:28.839680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7908-829a-4f0e-ad6c-e16166d9ba6d service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:28.839952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7908-829a-4f0e-ad6c-e16166d9ba6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:28.840226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7908-829a-4f0e-ad6c-e16166d9ba6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:28.849255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c7908-829a-4f0e-ad6c-e16166d9ba6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:28.850677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c7908-829a-4f0e-ad6c-e16166d9ba6d service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:28.859972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1175/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:29.130271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:29.131716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:29.143835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea415b1-97c7-4ac5-b237-922bec0cdda7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:29.148767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:29.149398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:29.149673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:29.149940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] PATH_INFO: `/v3/projects/82396eb83964499a91dfcac966e3179f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:29.151058 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82396eb83964499a91dfcac966e3179f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:29.153011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:29.200498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82396eb83964499a91dfcac966e3179f', 'request_id': 'req-33411a07-9198-4d45-89aa-c3afae2ed0f3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:29.206061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82396eb83964499a91dfcac966e3179f', 'request_id': 'req-33411a07-9198-4d45-89aa-c3afae2ed0f3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:29.213154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82396eb83964499a91dfcac966e3179f', 'request_id': 'req-33411a07-9198-4d45-89aa-c3afae2ed0f3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:29.223802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] The token cache is being invalidate because project 82396eb83964499a91dfcac966e3179f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:23:29.224102 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:29.224725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:29.226216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1131/2306] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:23:29 2022] DELETE /identity/v3/projects/82396eb83964499a91dfcac966e3179f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:38.855828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=33,keystone:DELETE=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:39.220874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:56.594809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:56.595327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:56.595448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:56.617019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:56.618537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:56.674505 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1176/2307] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:23:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:56.686631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:56.688119 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:56.759851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411a07-9198-4d45-89aa-c3afae2ed0f3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:56.764834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bdc4f-69a0-451f-976a-27a8dc2f8e80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:56.765437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bdc4f-69a0-451f-976a-27a8dc2f8e80 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:56.765713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bdc4f-69a0-451f-976a-27a8dc2f8e80 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:56.765981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bdc4f-69a0-451f-976a-27a8dc2f8e80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:56.773929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bdc4f-69a0-451f-976a-27a8dc2f8e80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:56.775528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bdc4f-69a0-451f-976a-27a8dc2f8e80 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:56.783449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1132/2308] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:24:06.359266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:06.361067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:06.434367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7993d7-2690-4eaf-8bbf-09af9ea68d4d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:06.439381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:06.439981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:06.440260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:06.441074 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:06.442797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:06.454251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:06.455829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf51c7-bbb0-4ded-abef-5f23281c2776 service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:06.466245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1177/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:24:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:24:06.780278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=32 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:11.179276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15349b-5607-4128-8265-71f49bc6bebc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.179960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15349b-5607-4128-8265-71f49bc6bebc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.179960 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15349b-5607-4128-8265-71f49bc6bebc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.181197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1133/2310] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:24:11.186963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371e7a5-2cdd-4925-bef7-faf29a71dfd9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.187392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371e7a5-2cdd-4925-bef7-faf29a71dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.187561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371e7a5-2cdd-4925-bef7-faf29a71dfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.208138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a371e7a5-2cdd-4925-bef7-faf29a71dfd9 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:11.209386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a371e7a5-2cdd-4925-bef7-faf29a71dfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:11.280832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1178/2311] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:11.293121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15349b-5607-4128-8265-71f49bc6bebc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:11.294833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ae15349b-5607-4128-8265-71f49bc6bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:11.353214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15349b-5607-4128-8265-71f49bc6bebc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:11.356667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e7c44-bf0f-49f8-9f7c-4030de5c3574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:11.357260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7c44-bf0f-49f8-9f7c-4030de5c3574 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.357531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7c44-bf0f-49f8-9f7c-4030de5c3574 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.357797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7c44-bf0f-49f8-9f7c-4030de5c3574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.367617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e7c44-bf0f-49f8-9f7c-4030de5c3574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:11.369071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e7c44-bf0f-49f8-9f7c-4030de5c3574 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:11.380122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1134/2312] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:24:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:24:11.448944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593703f-0fba-498c-b0de-cdb6395fb19a None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.449229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593703f-0fba-498c-b0de-cdb6395fb19a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.449520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593703f-0fba-498c-b0de-cdb6395fb19a None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.450851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1179/2313] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:24:11.455401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dccc70-3be1-4baa-9c79-d47b86d23670 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.455703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dccc70-3be1-4baa-9c79-d47b86d23670 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.456547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dccc70-3be1-4baa-9c79-d47b86d23670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.475806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-44dccc70-3be1-4baa-9c79-d47b86d23670 None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:11.477146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-44dccc70-3be1-4baa-9c79-d47b86d23670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:11.528955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1135/2314] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:11.541005 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593703f-0fba-498c-b0de-cdb6395fb19a None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:11.542697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1593703f-0fba-498c-b0de-cdb6395fb19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:11.555612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593703f-0fba-498c-b0de-cdb6395fb19a None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:11.559099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a4641-ac9e-4592-a184-1d1a4465d60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:11.559688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4641-ac9e-4592-a184-1d1a4465d60d service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.559967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4641-ac9e-4592-a184-1d1a4465d60d service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.560237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4641-ac9e-4592-a184-1d1a4465d60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.567904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a4641-ac9e-4592-a184-1d1a4465d60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:11.569354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a4641-ac9e-4592-a184-1d1a4465d60d service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:11.577010 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1180/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:24:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:24:11.660616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d19d-1b7e-4ecc-a4a8-dc54fc9a66e0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.660835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d19d-1b7e-4ecc-a4a8-dc54fc9a66e0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.661108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d19d-1b7e-4ecc-a4a8-dc54fc9a66e0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.662449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1136/2316] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:24:11.667674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23439f-101c-4690-ac06-9a07eff0d56a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.667957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23439f-101c-4690-ac06-9a07eff0d56a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.668233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23439f-101c-4690-ac06-9a07eff0d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.688689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9c23439f-101c-4690-ac06-9a07eff0d56a None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:11.689881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9c23439f-101c-4690-ac06-9a07eff0d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:11.699514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1181/2317] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:11.710855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d19d-1b7e-4ecc-a4a8-dc54fc9a66e0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:11.721739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d19d-1b7e-4ecc-a4a8-dc54fc9a66e0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:11.725290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:11.725871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:11.726145 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:11.726413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:11.736491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:11.738653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:11.749367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1137/2318] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:24:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:24:14.210589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19074f9-de83-4f42-953e-ff99371f082a None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:14.211083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19074f9-de83-4f42-953e-ff99371f082a None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:14.211185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19074f9-de83-4f42-953e-ff99371f082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:14.224153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:14.230250 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f19074f9-de83-4f42-953e-ff99371f082a None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:14.231716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f19074f9-de83-4f42-953e-ff99371f082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:14.239919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1182/2319] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:14.263623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:14.275275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0acd-1655-46b7-9c52-5a0fe7d1aa14 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:14.280222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:14.280851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:14.281129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:14.281396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:14.290099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:14.291670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:14.299530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1138/2320] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:24:24.296545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=61 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:40.486139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083820-c629-4673-8921-36f6975c5c36 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:40.486674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083820-c629-4673-8921-36f6975c5c36 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:40.486674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083820-c629-4673-8921-36f6975c5c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:40.505761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a7083820-c629-4673-8921-36f6975c5c36 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:40.506984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a7083820-c629-4673-8921-36f6975c5c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:40.514807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1183/2321] 10.222.0.25 () {58 vars in 967 bytes} [Sun Aug 7 18:24:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:40.528193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:40.539453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fabd8b-6166-4042-91e7-79c730650a6f service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:40.544468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:40.545088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:40.545362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:40.545660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:40.553839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:40.555403 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:40.564181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1139/2322] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:24:50.502019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:50.560415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:54.888222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:54.888781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:54.888781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:54.907914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] MFA Rules not processed for user `17943c8309fc4e97b180373b320595f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:54.909182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:54.969916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1184/2323] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:24:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:04.282871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:04.284330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:04.300404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee1fd-5e42-4efb-8f08-7bb0afca0f15 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:04.305601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:04.306302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:04.306621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:04.306991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:04.309025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:04.327175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:04.328647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b28da-4dd6-40ba-9aba-b38dd2fb4f5c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:04.341522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1140/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:04.963132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=25 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:09.233880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:09.243481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf1b43-7357-4488-877c-3eee0f058171 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:09.247216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:09.247795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:09.248066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:09.248332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:09.250041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:09.264552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:09.266054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:09.277548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1185/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:14.337425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:14.521622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:14.521896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:14.522168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:14.542200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] MFA Rules not processed for user `a38be80ef1854cb3aeaa5ca40ed043f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:14.543402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:14.600136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1141/2326] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:25:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:25:15.205700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:15.207806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:15.222724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3376e32-67b2-4d1e-9355-d277155891bd service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:15.227603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:15.228196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:15.228468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:15.228765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:15.230751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:15.243332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:15.244971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:15.258443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1186/2327] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:25:21.046224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:21.056676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc37c3-c0eb-486c-8cdc-3cc1507c56dc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:21.060268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:21.060906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:21.061183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:21.061456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:21.063178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:21.073813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:21.075315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:21.083598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1142/2328] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:25.251760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=12 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:25.775933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:25.777292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:25.792914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc9a4-a9c2-49ca-b6d8-3d138dddd082 service placement] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:25.798193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:25.798787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:25.799059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:25.799320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:25.801034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:25.812269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:25.813862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:25.822676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1187/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:31.080055 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=31 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:35.818655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=6 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:40.934487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:40.937036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:40.960151 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80ae2f-00c0-41af-915b-79f8704e2eb1 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:40.966551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:40.967340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:40.967719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:40.968091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:40.970114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:40.985529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:40.987133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb674c7e-265d-4313-8c22-45daca5f4db7 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:40.999847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1143/2330] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:47.942773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:47.954889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5c32-e131-4923-a5e3-770213b19c24 service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:47.961727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:47.962327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:47.962602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:47.962870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:47.964734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:47.978994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:47.980632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:47.991318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1188/2331] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:49.546212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f5b8-9ca1-44b4-b056-27263427010a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:49.546681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f5b8-9ca1-44b4-b056-27263427010a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:49.546801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f5b8-9ca1-44b4-b056-27263427010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:49.565237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ad15f5b8-9ca1-44b4-b056-27263427010a None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:49.566432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad15f5b8-9ca1-44b4-b056-27263427010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:49.574316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1144/2332] 10.222.0.25 () {58 vars in 967 bytes} [Sun Aug 7 18:25:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:49.623334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:49.635093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da54d-afb3-4d60-a99b-d740b7f0a635 service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:49.639988 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacdee4-94a6-4443-9fb2-fc686e83cd69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:49.640628 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacdee4-94a6-4443-9fb2-fc686e83cd69 service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:49.640905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacdee4-94a6-4443-9fb2-fc686e83cd69 service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:49.641171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacdee4-94a6-4443-9fb2-fc686e83cd69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:49.650942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacdee4-94a6-4443-9fb2-fc686e83cd69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:49.652694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacdee4-94a6-4443-9fb2-fc686e83cd69 service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:49.660817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1189/2333] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:25:57.572313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e865-f71b-4800-9c3f-f41e7aa405a7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:57.573721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e865-f71b-4800-9c3f-f41e7aa405a7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:57.574298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e865-f71b-4800-9c3f-f41e7aa405a7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:57.575671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1145/2334] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:25:57.620826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:57.621378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:57.621378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:57.647509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] MFA Rules not processed for user `3a8c8efd39f14b65984c0d2a8782e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:57.648905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:57.658719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1190/2335] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:57.667274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e865-f71b-4800-9c3f-f41e7aa405a7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:57.669732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5635e865-f71b-4800-9c3f-f41e7aa405a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:57.689676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:57.706051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46cb62-778c-4359-8c03-2d0a22f8ab71 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:57.713442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692902-95b2-40c3-ab82-96379f48c0cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:57.714145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692902-95b2-40c3-ab82-96379f48c0cb service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:57.714835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692902-95b2-40c3-ab82-96379f48c0cb service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:57.715422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692902-95b2-40c3-ab82-96379f48c0cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:57.730482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692902-95b2-40c3-ab82-96379f48c0cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:57.732087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692902-95b2-40c3-ab82-96379f48c0cb service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:57.745889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1191/2336] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:57.754946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e865-f71b-4800-9c3f-f41e7aa405a7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:57.761735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:57.762720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:57.765197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:57.765672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] PATH_INFO: `/v3/users/bd00e592a3c447a288e870e3e79ea982` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:57.767358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd00e592a3c447a288e870e3e79ea982)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:57.770043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:57.827800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd00e592a3c447a288e870e3e79ea982'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:57.838049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd00e592a3c447a288e870e3e79ea982'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:57.839009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd00e592a3c447a288e870e3e79ea982'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:57.839685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd00e592a3c447a288e870e3e79ea982'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:57.847490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd00e592a3c447a288e870e3e79ea982'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:57.868879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1146/2337] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:25:57 2022] DELETE /identity/v3/users/bd00e592a3c447a288e870e3e79ea982 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:25:58.017702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:58.018255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:58.018775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:58.041636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] MFA Rules not processed for user `0b74cad47e9a4dd1b8b931d3934ae70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:58.042948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:58.085109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:58.086654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:58.107311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1192/2338] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:58.171231 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b929d60-14c4-41d2-81cd-4a8c1fba1100 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:58.176101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:58.176765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:58.177039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:58.177339 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] PATH_INFO: `/v3/projects/a5672187da684e4996513fc0bc54a870` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:58.179153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5672187da684e4996513fc0bc54a870)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:58.181093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:58.182705 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:58.231932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5672187da684e4996513fc0bc54a870', 'request_id': 'req-a7e88b91-2e2a-450d-9463-b83a32a2e63d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.238625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5672187da684e4996513fc0bc54a870', 'request_id': 'req-a7e88b91-2e2a-450d-9463-b83a32a2e63d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.246944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5672187da684e4996513fc0bc54a870', 'request_id': 'req-a7e88b91-2e2a-450d-9463-b83a32a2e63d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.259420 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] The token cache is being invalidate because project a5672187da684e4996513fc0bc54a870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:25:58.259709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.260371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.261915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1147/2339] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:25:58 2022] DELETE /identity/v3/projects/a5672187da684e4996513fc0bc54a870 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:25:58.265930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:58.277164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1846e-68ea-47a0-813e-c60b26b043f4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:58.336911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:58.337550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:58.337826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:58.338095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] PATH_INFO: `/v3/users/27714921a34846e6a15c0a0c1c2231cd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:58.339220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27714921a34846e6a15c0a0c1c2231cd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:58.341377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:58.390891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27714921a34846e6a15c0a0c1c2231cd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.397873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27714921a34846e6a15c0a0c1c2231cd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.398575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27714921a34846e6a15c0a0c1c2231cd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.399203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27714921a34846e6a15c0a0c1c2231cd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.403467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:58.410099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27714921a34846e6a15c0a0c1c2231cd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.433485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1193/2340] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:25:58 2022] DELETE /identity/v3/users/27714921a34846e6a15c0a0c1c2231cd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:25:58.435720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:58.437310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:58.503753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88b91-2e2a-450d-9463-b83a32a2e63d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:58.559492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:58.560105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:58.560384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:58.560688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:58.562483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:58.572399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:58.573948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:58.582172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1148/2341] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:58.693599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:58.695198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:58.774475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa1005-f22d-49aa-9ecf-7916445b77d9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:58.779107 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:58.779732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:58.780004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:58.780274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] PATH_INFO: `/v3/projects/9629dfbe6bc14b9dab7316c05add2769` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:58.781417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9629dfbe6bc14b9dab7316c05add2769)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:58.783313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:58.836281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9629dfbe6bc14b9dab7316c05add2769', 'request_id': 'req-535f6ff7-0a84-465e-b618-8299f68fba72'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.842228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9629dfbe6bc14b9dab7316c05add2769', 'request_id': 'req-535f6ff7-0a84-465e-b618-8299f68fba72'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.850380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9629dfbe6bc14b9dab7316c05add2769', 'request_id': 'req-535f6ff7-0a84-465e-b618-8299f68fba72'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.862443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] The token cache is being invalidate because project 9629dfbe6bc14b9dab7316c05add2769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:25:58.862743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.863476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:25:58.865812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1194/2342] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:25:58 2022] DELETE /identity/v3/projects/9629dfbe6bc14b9dab7316c05add2769 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:03.274327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:03.275707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:03.328299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:03.332327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c228-1481-4dc2-b1f6-f92cad969186 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:03.383694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:03.384283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:03.384556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:03.384855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:03.386579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:03.443664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:03.445589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:03.454555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1149/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:06.976141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:06.977605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:06.991088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6ff7-0a84-465e-b618-8299f68fba72 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:06.995830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:06.996447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:06.996775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:06.997120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:06.999447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:07.069459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:07.070827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f47d67-3a40-437b-a434-8f193c5d2b77 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:07.080332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1195/2344] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:08.450725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:08.452718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:08.561090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb6e5-fcb3-44f4-8f41-7c184b83f8b7 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:08.566597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:08.568334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:08.569593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:08.569885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:08.571661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:08.585318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:08.586998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:08.599293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1150/2345] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:11.009849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:11.010351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:11.010449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:11.024095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:11.030708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] MFA Rules not processed for user `21b60f931d1948eb953e14ccee92da2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:11.032620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:11.041350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1196/2346] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:11.342838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:11.344229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:11.389608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:11.401219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c75fc-e285-492f-864f-a5f7dddc89d6 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:11.404780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:11.405379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:11.405653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:11.405924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:11.407623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:11.417449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:11.418903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:11.427017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1151/2347] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:21.423440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:28.394969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:28.396469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:28.410766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5a45-a8ba-49a0-b1bd-b92072594b93 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:28.415645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:28.416281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:28.416576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:28.416891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:28.419341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:28.496448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:28.497957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:28.507864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1197/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:31.738630 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:31.740181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:31.754943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7822e-cfb3-4efd-aad1-e2135e7483bc service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:31.760545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:31.761194 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:31.761474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:31.761750 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] PATH_INFO: `/v3/users/17943c8309fc4e97b180373b320595f1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:31.762878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17943c8309fc4e97b180373b320595f1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:31.764855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:31.814099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17943c8309fc4e97b180373b320595f1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:31.822072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17943c8309fc4e97b180373b320595f1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:31.822770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17943c8309fc4e97b180373b320595f1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:31.823380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17943c8309fc4e97b180373b320595f1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:31.830229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f56dbc98-b401-416e-a00c-0a3ad5a82d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17943c8309fc4e97b180373b320595f1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:31.847492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1152/2349] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:31 2022] DELETE /identity/v3/users/17943c8309fc4e97b180373b320595f1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:32.020764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.032418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24891-3304-40ce-91a7-e36d12d44d34 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.092511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.093159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.093433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.093699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] PATH_INFO: `/v3/projects/fcb3c6d07d0a4b028b6508d791729277` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.094831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb3c6d07d0a4b028b6508d791729277)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.096747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.143301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb3c6d07d0a4b028b6508d791729277', 'request_id': 'req-9981efe7-b28e-4df6-952d-5495bb70618b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:32.149419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb3c6d07d0a4b028b6508d791729277', 'request_id': 'req-9981efe7-b28e-4df6-952d-5495bb70618b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:32.156646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb3c6d07d0a4b028b6508d791729277', 'request_id': 'req-9981efe7-b28e-4df6-952d-5495bb70618b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:32.169151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] The token cache is being invalidate because project fcb3c6d07d0a4b028b6508d791729277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:32.169480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:32.170115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9981efe7-b28e-4df6-952d-5495bb70618b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:32.171591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1198/2350] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:32 2022] DELETE /identity/v3/projects/fcb3c6d07d0a4b028b6508d791729277 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:32.176939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.177221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.177495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.197458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:32.198574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:32.256751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1153/2351] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:32.265159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.265442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.265713 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.285368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:32.286582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:32.294985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1199/2352] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:32.299313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.308947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96ef4c-992f-44c8-81a8-daca5db044d5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.313456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.314039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.314311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.314578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.315208 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:32.315504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.317122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.329116 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1154/2353] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:32.333261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.343117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf688ba-4b73-467f-8322-9fd296a93fef None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.347811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.348402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.348708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.348978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.349597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.351486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.367642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:32.380529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1200/2354] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:32 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:26:32.385469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.395344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790b7a-56dd-4ee9-927a-6f3e3e06796d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.451068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.451595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.451874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.452146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.452805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.454721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.463371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:32.479790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1155/2355] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:32 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:32.483842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.495300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e45835-4b6e-4efe-84ad-ee7d63c5f5f0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.500033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.500674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.500954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.501228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.501897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.503487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.514768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1201/2356] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:32.518521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.529644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d873-2367-426e-8577-67b36908f5aa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.534410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bb7f-5b1f-4df9-8069-f74e4d3a09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.535012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bb7f-5b1f-4df9-8069-f74e4d3a09e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.535288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bb7f-5b1f-4df9-8069-f74e4d3a09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.535554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bb7f-5b1f-4df9-8069-f74e4d3a09e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.536186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bb7f-5b1f-4df9-8069-f74e4d3a09e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.538073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bb7f-5b1f-4df9-8069-f74e4d3a09e5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.548992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1156/2357] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:32.553138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.563978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712896c-c7ca-4958-a3e3-1f062748f2bd admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.568712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.569359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.569637 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.570795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] PATH_INFO: `/v3/projects/bf861e630e094b9284d21e951fed6bde/users/9b40302fafde45788369096dc43de3f2/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.586467 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf861e630e094b9284d21e951fed6bde, user_id=9b40302fafde45788369096dc43de3f2, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.589181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.605724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1202/2358] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:32 2022] PUT /identity/v3/projects/bf861e630e094b9284d21e951fed6bde/users/9b40302fafde45788369096dc43de3f2/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:32.611023 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662cbe5-be4f-46a1-9782-51e5525f5194 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.611402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662cbe5-be4f-46a1-9782-51e5525f5194 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.611676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662cbe5-be4f-46a1-9782-51e5525f5194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.631976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3662cbe5-be4f-46a1-9782-51e5525f5194 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:32.634078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3662cbe5-be4f-46a1-9782-51e5525f5194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:32.691323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1157/2359] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:32.701889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:32.703545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:32.759895 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d7c8a-c7a8-41f8-b782-fc4074a39cea admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:32.763523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:32.764120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:32.764394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:32.764702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:32.773737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:32.775161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:32.784755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1203/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:33.408316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.408817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.408914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.437095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] MFA Rules not processed for user `9b40302fafde45788369096dc43de3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:33.438300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:33.511128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1158/2361] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:33.515955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:33.526151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581160-a4e5-4a48-bb0c-14dbf9a967be service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:33.531565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:33.531807 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.532085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.532357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.533532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:33.534915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:33.565465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1204/2362] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:33 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:33.566734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:33.577958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b1ea2-9db6-422c-be34-59a34a4b6660 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:33.634544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:33.635142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.635413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.635678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.636285 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:33.638215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:33.653514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:33.659720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1159/2363] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:33 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:33.664554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:33.674788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f50144-a1c6-4de1-90de-89521a1bc892 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:33.680304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:33.680722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.680985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.681248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.681866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:33.683438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:33.694026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1205/2364] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:33.698786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:33.708922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c42d6-1a44-41ee-a0a3-fcf8d30122b3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:33.714445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:33.715080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.715359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.715659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] PATH_INFO: `/v3/projects/1b9fddfe89c54ac382dad91c2dad01c8/users/769ffb3961aa4a63ac811dd267e5736a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.730243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9fddfe89c54ac382dad91c2dad01c8, user_id=769ffb3961aa4a63ac811dd267e5736a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:33.733048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:33.746680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1160/2365] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:33 2022] PUT /identity/v3/projects/1b9fddfe89c54ac382dad91c2dad01c8/users/769ffb3961aa4a63ac811dd267e5736a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:33.750715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:33.761317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5a8e-8b42-4e5c-8c9c-0251d3f104cc admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:33.818878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86bac-fc4d-4f99-8023-ead3abaa4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:33.819476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86bac-fc4d-4f99-8023-ead3abaa4f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.820329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86bac-fc4d-4f99-8023-ead3abaa4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.820690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86bac-fc4d-4f99-8023-ead3abaa4f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.821321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86bac-fc4d-4f99-8023-ead3abaa4f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:33.822909 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86bac-fc4d-4f99-8023-ead3abaa4f6e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:33.832457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1206/2366] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:33.837529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:33.847714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52da5-3cc7-4f93-8b63-b847bdc40351 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:33.852691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:33.853331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:33.853625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:33.853880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] PATH_INFO: `/v3/projects/1b9fddfe89c54ac382dad91c2dad01c8/users/769ffb3961aa4a63ac811dd267e5736a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:33.855736 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9fddfe89c54ac382dad91c2dad01c8, user_id=769ffb3961aa4a63ac811dd267e5736a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:33.858400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:33.868974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1161/2367] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:33 2022] PUT /identity/v3/projects/1b9fddfe89c54ac382dad91c2dad01c8/users/769ffb3961aa4a63ac811dd267e5736a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:34.492400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:34.492717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:34.492992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:34.520587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] MFA Rules not processed for user `769ffb3961aa4a63ac811dd267e5736a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:34.521829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:34.535050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:34.596880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1207/2368] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:35.567586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:35.569345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:35.627561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:35.646401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfad0f1-af6c-4a3b-857c-92fed604f582 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:35.652718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:35.653359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:35.653625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:35.653893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:35.655627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:35.668656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:35.670241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:35.680221 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1162/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:35.699288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55c32-b8c9-4bdb-99fe-b8008e5a0b69 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:35.703752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:35.704374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:35.704673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:35.704945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] PATH_INFO: `/v3/users/9b40302fafde45788369096dc43de3f2` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:35.706037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b40302fafde45788369096dc43de3f2)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:35.707956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:35.753916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b40302fafde45788369096dc43de3f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:35.761182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b40302fafde45788369096dc43de3f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:35.761850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b40302fafde45788369096dc43de3f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:35.762448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b40302fafde45788369096dc43de3f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:35.769706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b40302fafde45788369096dc43de3f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:35.787586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1208/2370] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:35 2022] DELETE /identity/v3/users/9b40302fafde45788369096dc43de3f2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:26:35.959161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:35.971210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab38d-84e9-433d-8c7a-e3a997a6c302 service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.032232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.032810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.033086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.033352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] PATH_INFO: `/v3/projects/bf861e630e094b9284d21e951fed6bde` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.034441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf861e630e094b9284d21e951fed6bde)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.036328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.081934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf861e630e094b9284d21e951fed6bde', 'request_id': 'req-3939dedb-aacf-47c9-9311-2ea8ca44f270'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.083811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:36.089217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf861e630e094b9284d21e951fed6bde', 'request_id': 'req-3939dedb-aacf-47c9-9311-2ea8ca44f270'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.096869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf861e630e094b9284d21e951fed6bde', 'request_id': 'req-3939dedb-aacf-47c9-9311-2ea8ca44f270'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.107842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] The token cache is being invalidate because project bf861e630e094b9284d21e951fed6bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:36.108123 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.109518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.110999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1163/2371] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:35 2022] DELETE /identity/v3/projects/bf861e630e094b9284d21e951fed6bde => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:36.115026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.116499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:36.132887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1675d-6cb5-497f-8465-1733a57d3ddf admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.164625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:36.194077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.195196 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.195474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.195740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] PATH_INFO: `/v3/users/769ffb3961aa4a63ac811dd267e5736a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.196870 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=769ffb3961aa4a63ac811dd267e5736a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.198760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.243510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769ffb3961aa4a63ac811dd267e5736a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.250360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769ffb3961aa4a63ac811dd267e5736a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.251024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769ffb3961aa4a63ac811dd267e5736a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.251630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769ffb3961aa4a63ac811dd267e5736a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.259643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-416a83b0-adfa-4e3b-951a-7cf67f18b44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769ffb3961aa4a63ac811dd267e5736a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.277916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1209/2372] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:36 2022] DELETE /identity/v3/users/769ffb3961aa4a63ac811dd267e5736a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:36.450533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.452061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:36.466564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939dedb-aacf-47c9-9311-2ea8ca44f270 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.522608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.523734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.524149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.524421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] PATH_INFO: `/v3/projects/1b9fddfe89c54ac382dad91c2dad01c8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.525569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9fddfe89c54ac382dad91c2dad01c8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.527488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.572528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9fddfe89c54ac382dad91c2dad01c8', 'request_id': 'req-3fa49f6d-921d-4377-83db-2ca4c6fb3830'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.578115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9fddfe89c54ac382dad91c2dad01c8', 'request_id': 'req-3fa49f6d-921d-4377-83db-2ca4c6fb3830'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.584899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9fddfe89c54ac382dad91c2dad01c8', 'request_id': 'req-3fa49f6d-921d-4377-83db-2ca4c6fb3830'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.596109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] The token cache is being invalidate because project 1b9fddfe89c54ac382dad91c2dad01c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:36.596400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.597068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fa49f6d-921d-4377-83db-2ca4c6fb3830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:36.598539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1164/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:36 2022] DELETE /identity/v3/projects/1b9fddfe89c54ac382dad91c2dad01c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:36.603978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.604263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.604539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.623913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:36.625161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:36.687016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1210/2374] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:36.695366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.696066 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.696172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.717046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:36.718327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:36.730355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1165/2375] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:36.731318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.741180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ed065-a155-4331-8e6f-2f97473e0712 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.746354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.746944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.747219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.747490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.748124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:36.748424 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.750038 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.762293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1211/2376] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:36.766712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.777257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cd6fc-e7e9-4c45-80fd-0ef786cd87e7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.781915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.782502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.782779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.783044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.783668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.785595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.813406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1166/2377] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:36 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:36.817678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.828412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34e7e-2953-4eac-a563-42010fad5e40 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.861352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:36.887034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.887643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.887920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.888192 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.888852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.890848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.915559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1212/2378] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:36 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:26:36.917084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.927684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624d20b-d7ba-4a35-a222-c3b344ba0a3b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.932366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.932992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.933270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.933542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.934180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.935763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.946675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1167/2379] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:36.950800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.962106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c799c-38ce-4390-b610-b57f2815f380 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.966919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7410-8365-4b68-bbc7-e59cac22de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.967503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7410-8365-4b68-bbc7-e59cac22de51 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.967776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7410-8365-4b68-bbc7-e59cac22de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:36.968042 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7410-8365-4b68-bbc7-e59cac22de51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:36.968788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a7410-8365-4b68-bbc7-e59cac22de51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:36.970355 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a7410-8365-4b68-bbc7-e59cac22de51 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:36.980217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1213/2380] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:36.984335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:36.994485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1c735-c397-4fe3-b4da-77a21e75b83f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:36.999040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:36.999661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:36.999941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.000216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] PATH_INFO: `/v3/projects/99ef8976d4274788a80e918a7acfe03d/users/d9fe6866020c418fb94512bceb0ca64d/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.015139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ef8976d4274788a80e918a7acfe03d, user_id=d9fe6866020c418fb94512bceb0ca64d, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.017810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.032029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1168/2381] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:36 2022] PUT /identity/v3/projects/99ef8976d4274788a80e918a7acfe03d/users/d9fe6866020c418fb94512bceb0ca64d/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:37.042531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.042831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.043102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.071058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] MFA Rules not processed for user `d9fe6866020c418fb94512bceb0ca64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:37.072335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:37.134878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1214/2382] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:37.139363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.148412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:37.201978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17e9b4-d570-4bd2-9b15-2eabc7804340 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.206558 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.207149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.207421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.207686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.208291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.210223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.235189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1169/2383] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:37 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:37.239329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.250531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa992ad2-1439-4e0c-a34b-6726c525d58f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.308688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.309278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.309552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.309846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.310482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.312457 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.332997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1215/2384] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:37 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:37.337300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.347462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862e95-e09f-4b09-80d4-d93c923e35e6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.352012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.352689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.352971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.353240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.353873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.355452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.366064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1170/2385] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:37.371104 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.381048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41160d25-6cfa-42e9-b161-9f867cf7ae21 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.386666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.387257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.387533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.387805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] PATH_INFO: `/v3/projects/796e8861d0ff497c99b8676a5a210138/users/0da4c833e1e0486e8a44d3702de3b400/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.403813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=796e8861d0ff497c99b8676a5a210138, user_id=0da4c833e1e0486e8a44d3702de3b400, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.406518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.419422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1216/2386] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:37 2022] PUT /identity/v3/projects/796e8861d0ff497c99b8676a5a210138/users/0da4c833e1e0486e8a44d3702de3b400/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:37.423387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.433984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18fd2-4a45-419d-ab2b-97c72cefca6d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.487936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb178199-0d14-4560-a83e-9a38cbe6cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.488530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb178199-0d14-4560-a83e-9a38cbe6cfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.488836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb178199-0d14-4560-a83e-9a38cbe6cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.489103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb178199-0d14-4560-a83e-9a38cbe6cfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.489729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb178199-0d14-4560-a83e-9a38cbe6cfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.491310 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb178199-0d14-4560-a83e-9a38cbe6cfb3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.502377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1171/2387] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:37.506580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.517211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a91814-12e9-4999-87ad-bb9adeb46acf admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.521746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.522383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.522660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.523423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] PATH_INFO: `/v3/projects/796e8861d0ff497c99b8676a5a210138/users/0da4c833e1e0486e8a44d3702de3b400/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.525354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=796e8861d0ff497c99b8676a5a210138, user_id=0da4c833e1e0486e8a44d3702de3b400, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.527968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.533345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:37.540326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1217/2388] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:37 2022] PUT /identity/v3/projects/796e8861d0ff497c99b8676a5a210138/users/0da4c833e1e0486e8a44d3702de3b400/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:37.551538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.551913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.552190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.579490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] MFA Rules not processed for user `0da4c833e1e0486e8a44d3702de3b400`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:37.580719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:37.646713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1172/2389] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:37.657911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:37.659714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:37.716408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eef6c-b340-4d36-b3f2-8c51c64c54fe admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:37.720108 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9156d3-e41c-4e8b-88c0-a4865d362210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:37.720744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9156d3-e41c-4e8b-88c0-a4865d362210 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:37.721023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9156d3-e41c-4e8b-88c0-a4865d362210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:37.721289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9156d3-e41c-4e8b-88c0-a4865d362210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:37.730703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9156d3-e41c-4e8b-88c0-a4865d362210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:37.732131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9156d3-e41c-4e8b-88c0-a4865d362210 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:37.741673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1218/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:38.155702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:38.159911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:38.218767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92e0f-c9e2-4aa7-96ce-868aa8d0786a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:38.223245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:38.223866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:38.224142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:38.224412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] PATH_INFO: `/v3/users/d9fe6866020c418fb94512bceb0ca64d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:38.225541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fe6866020c418fb94512bceb0ca64d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:38.228104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:38.272284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fe6866020c418fb94512bceb0ca64d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.278777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fe6866020c418fb94512bceb0ca64d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.279399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fe6866020c418fb94512bceb0ca64d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.279998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fe6866020c418fb94512bceb0ca64d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.286751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fe6866020c418fb94512bceb0ca64d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.305079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1173/2391] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:38 2022] DELETE /identity/v3/users/d9fe6866020c418fb94512bceb0ca64d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:38.309298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:38.309582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:38.309851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:38.328302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:38.329522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:38.387035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1219/2392] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:38.396890 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:38.398801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:38.458286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bf1f8-ef2a-4a53-877d-7288809a3bc8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:38.462280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:38.462916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:38.463687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:38.463687 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:38.472645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:38.474064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:38.484350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1174/2393] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:38.751876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:38.753395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:38.767428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ba0e0-a128-4a63-b555-8188003efc1e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:38.773464 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:38.774270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:38.774562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:38.774889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] PATH_INFO: `/v3/projects/99ef8976d4274788a80e918a7acfe03d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:38.776017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ef8976d4274788a80e918a7acfe03d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:38.777879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:38.826821 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ef8976d4274788a80e918a7acfe03d', 'request_id': 'req-0f469e07-19f1-4dc7-82b3-c36215644511'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.832359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ef8976d4274788a80e918a7acfe03d', 'request_id': 'req-0f469e07-19f1-4dc7-82b3-c36215644511'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.840352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ef8976d4274788a80e918a7acfe03d', 'request_id': 'req-0f469e07-19f1-4dc7-82b3-c36215644511'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.852333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] The token cache is being invalidate because project 99ef8976d4274788a80e918a7acfe03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:38.852649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.853316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.854814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1220/2394] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:38 2022] DELETE /identity/v3/projects/99ef8976d4274788a80e918a7acfe03d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:38.858821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:38.868934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7356b-32a4-4f0e-9ff1-4fb26a28120b service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:38.888517 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:38.925599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:38.926215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:38.926490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:38.926756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] PATH_INFO: `/v3/users/0da4c833e1e0486e8a44d3702de3b400` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:38.927852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da4c833e1e0486e8a44d3702de3b400)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:38.930350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:38.979625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da4c833e1e0486e8a44d3702de3b400'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.987010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da4c833e1e0486e8a44d3702de3b400'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.987636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da4c833e1e0486e8a44d3702de3b400'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.988229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da4c833e1e0486e8a44d3702de3b400'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:38.996039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9cb99ac0-ef88-4081-b099-3ed7f794fd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da4c833e1e0486e8a44d3702de3b400'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:39.013340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1175/2395] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:38 2022] DELETE /identity/v3/users/0da4c833e1e0486e8a44d3702de3b400 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:39.304282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.305931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:39.320468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f469e07-19f1-4dc7-82b3-c36215644511 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.341763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:39.380395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.381058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.381333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.381603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] PATH_INFO: `/v3/projects/796e8861d0ff497c99b8676a5a210138` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.382757 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796e8861d0ff497c99b8676a5a210138)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.384840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.431215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796e8861d0ff497c99b8676a5a210138', 'request_id': 'req-0cc47a49-335d-49af-a3eb-bafbf51139c3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:39.436743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796e8861d0ff497c99b8676a5a210138', 'request_id': 'req-0cc47a49-335d-49af-a3eb-bafbf51139c3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:39.444451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796e8861d0ff497c99b8676a5a210138', 'request_id': 'req-0cc47a49-335d-49af-a3eb-bafbf51139c3'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:39.455442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] The token cache is being invalidate because project 796e8861d0ff497c99b8676a5a210138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:39.455733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:39.456363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0cc47a49-335d-49af-a3eb-bafbf51139c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:39.457969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1221/2396] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:39 2022] DELETE /identity/v3/projects/796e8861d0ff497c99b8676a5a210138 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:39.463387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.463702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.463976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.484222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:39.485453 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:39.545619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1176/2397] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:39.553340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.553625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.553902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.572970 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:39.574279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:39.582305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1222/2398] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:39.587130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.596787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b2a98-4efe-45ca-b51e-cab7e99c5e8b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.602035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.602622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.602897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.603163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.603803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:39.604104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.605719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.617438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1177/2399] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:39.621822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.630955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c3af-a287-4247-98dc-6797f229bcb1 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.635546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.636128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.636448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.636750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.637370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.639280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.667514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1223/2400] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:39 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:39.671606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.682362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d923-2983-4eda-bbd8-1e8578a26dd8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.711639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:39.740538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.741170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.741445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.741715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.742336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.744232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.765081 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1178/2401] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:39 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:39.769318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.780110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d596b-e958-4d17-a5a1-d2e0ac4636f7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.784654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.785236 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.785515 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.785779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.786400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.788275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.798433 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1224/2402] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:39.802492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.812676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e3c76-5b60-4fa8-b8de-fee46e81d115 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.817305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f1f36-44a1-4a18-8390-09993710538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.817892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f1f36-44a1-4a18-8390-09993710538a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.818165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f1f36-44a1-4a18-8390-09993710538a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.818431 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f1f36-44a1-4a18-8390-09993710538a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.819059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f1f36-44a1-4a18-8390-09993710538a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.821215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f1f36-44a1-4a18-8390-09993710538a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.831546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1179/2403] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:39.836531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:39.846494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a74922-5981-4dbc-864f-7766df1a4c6f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:39.851073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:39.851709 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.851986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.852254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] PATH_INFO: `/v3/projects/5d3d62fe9d924311afae719ecc790f61/users/c6d74553eec14d2d99025c342ecd0946/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.866453 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3d62fe9d924311afae719ecc790f61, user_id=c6d74553eec14d2d99025c342ecd0946, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:39.869115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:39.881403 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1225/2404] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:39 2022] PUT /identity/v3/projects/5d3d62fe9d924311afae719ecc790f61/users/c6d74553eec14d2d99025c342ecd0946/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:26:39.893283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:39.893749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:39.893864 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:39.920839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] MFA Rules not processed for user `c6d74553eec14d2d99025c342ecd0946`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:39.922032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:39.984762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1180/2405] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:39.989217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.039873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:40.052061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a1c05-d422-4b16-b02c-0abbbebeaf37 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.057255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.057851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.058125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.058401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.059005 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.060929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.087921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1226/2406] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:39 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:40.092005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.102698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114060ab-204b-4d20-95ca-630ed4a2aec2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.157983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.158580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.158861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.159135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.159747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.161701 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.182946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1181/2407] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:40 2022] POST /identity/v3/users => generated 310 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:40.187159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.198470 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691d0b9-9eaf-494b-ac68-d9f11e66f2d3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.203049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.203641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.203917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.204188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.204851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.206442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.218093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1227/2408] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:40.222213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.232000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0ff7b-ce3a-407b-a3fc-d0c94ed21085 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.236492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.237174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.237441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.237698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] PATH_INFO: `/v3/projects/b96d1602971f49ce97c4ce27124e8065/users/e6dec065bfba485c9d23018028640554/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.252459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96d1602971f49ce97c4ce27124e8065, user_id=e6dec065bfba485c9d23018028640554, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.255090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.267894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1182/2409] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:40 2022] PUT /identity/v3/projects/b96d1602971f49ce97c4ce27124e8065/users/e6dec065bfba485c9d23018028640554/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:40.271908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.282381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f230cc-5510-4c73-99b9-b1fadc9e4456 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.338120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb63f30-be71-487a-b805-1b7c4c3697ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.338636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb63f30-be71-487a-b805-1b7c4c3697ae admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.338907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb63f30-be71-487a-b805-1b7c4c3697ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.339172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb63f30-be71-487a-b805-1b7c4c3697ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.339791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb63f30-be71-487a-b805-1b7c4c3697ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.341409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb63f30-be71-487a-b805-1b7c4c3697ae admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.351032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1228/2410] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:40.355072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.361746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:40.365639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd709c9-e6e8-4931-960a-809f8eca5dd5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.371854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.372500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.372813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.373088 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] PATH_INFO: `/v3/projects/b96d1602971f49ce97c4ce27124e8065/users/e6dec065bfba485c9d23018028640554/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.374964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96d1602971f49ce97c4ce27124e8065, user_id=e6dec065bfba485c9d23018028640554, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.377671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.388725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1183/2411] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:40 2022] PUT /identity/v3/projects/b96d1602971f49ce97c4ce27124e8065/users/e6dec065bfba485c9d23018028640554/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:40.400034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.400291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.400590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.428418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] MFA Rules not processed for user `e6dec065bfba485c9d23018028640554`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:40.430391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:40.498432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1229/2412] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:40 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:40.509308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.511025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:40.568205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cf785-4428-4c6f-8dc0-abb89c006a73 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.571899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.572484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.572800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.573061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.581847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.583265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.592778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1184/2413] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:40 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:40.740260 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.750866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97ea8-56bd-4f3b-8abc-24ecf6e25e54 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.754432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b8d9-7f52-4eeb-82f2-a642ae2097a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.755053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b8d9-7f52-4eeb-82f2-a642ae2097a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.755328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b8d9-7f52-4eeb-82f2-a642ae2097a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.755622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b8d9-7f52-4eeb-82f2-a642ae2097a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.800805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:40.815503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1b8d9-7f52-4eeb-82f2-a642ae2097a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.816982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1b8d9-7f52-4eeb-82f2-a642ae2097a8 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.826072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1230/2414] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:40 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:46.070404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.132691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a821b-c9bf-4e6b-bde6-01b1665b5736 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.137408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.138039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.138317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.138617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] PATH_INFO: `/v3/users/c6d74553eec14d2d99025c342ecd0946` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.139723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d74553eec14d2d99025c342ecd0946)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.141677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.190904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d74553eec14d2d99025c342ecd0946'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.201919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d74553eec14d2d99025c342ecd0946'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.203034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d74553eec14d2d99025c342ecd0946'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.203860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d74553eec14d2d99025c342ecd0946'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.212462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d74553eec14d2d99025c342ecd0946'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.233643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1185/2415] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:46 2022] DELETE /identity/v3/users/c6d74553eec14d2d99025c342ecd0946 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:46.237793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.238291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.238387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.258858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:46.260067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:46.321974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1231/2416] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:46.332840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.334360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:46.349076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:46.394603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6eb1-d66f-438f-a8f6-f39fbb7658ec admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.398390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.399011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.399284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.399548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.408371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.409836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.419887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1186/2417] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:26:46.678605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.680877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:46.693059 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6df97-298a-432d-93bc-491b0e810264 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.698616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.699248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.699525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.699796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] PATH_INFO: `/v3/projects/5d3d62fe9d924311afae719ecc790f61` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.700943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3d62fe9d924311afae719ecc790f61)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.702844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.752659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3d62fe9d924311afae719ecc790f61', 'request_id': 'req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.759140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3d62fe9d924311afae719ecc790f61', 'request_id': 'req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.766251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3d62fe9d924311afae719ecc790f61', 'request_id': 'req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.778568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] The token cache is being invalidate because project 5d3d62fe9d924311afae719ecc790f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:46.778851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.779475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.780981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1232/2418] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:46 2022] DELETE /identity/v3/projects/5d3d62fe9d924311afae719ecc790f61 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:46.784958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.795505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09025dc1-720a-4be0-8e74-7c72ce5aa5c2 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.851324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.851989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.852268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.852540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] PATH_INFO: `/v3/users/e6dec065bfba485c9d23018028640554` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.853697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dec065bfba485c9d23018028640554)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.855684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.900588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dec065bfba485c9d23018028640554'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.907505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dec065bfba485c9d23018028640554'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.908186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dec065bfba485c9d23018028640554'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.908818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dec065bfba485c9d23018028640554'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.916072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc7d8fc7-b9eb-46dc-bee9-6768d742cb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dec065bfba485c9d23018028640554'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:46.933720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1187/2419] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:46 2022] DELETE /identity/v3/users/e6dec065bfba485c9d23018028640554 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:47.215900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.217426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:47.231999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f4bdd-aff5-447a-a1ca-d48d76b2bfb9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.293195 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.293826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.294086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.294361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] PATH_INFO: `/v3/projects/b96d1602971f49ce97c4ce27124e8065` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.295489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96d1602971f49ce97c4ce27124e8065)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.297432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.309131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:47.347023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96d1602971f49ce97c4ce27124e8065', 'request_id': 'req-13c2976d-566c-444b-a647-0029c7742518'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:47.353032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96d1602971f49ce97c4ce27124e8065', 'request_id': 'req-13c2976d-566c-444b-a647-0029c7742518'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:47.361363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96d1602971f49ce97c4ce27124e8065', 'request_id': 'req-13c2976d-566c-444b-a647-0029c7742518'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:47.372873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] The token cache is being invalidate because project b96d1602971f49ce97c4ce27124e8065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:47.373165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:47.373818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-13c2976d-566c-444b-a647-0029c7742518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:47.375316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1233/2420] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:47 2022] DELETE /identity/v3/projects/b96d1602971f49ce97c4ce27124e8065 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:47.381019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.381478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.381681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.401776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:47.402986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:47.436607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:47.467949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1188/2421] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:47.475667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.476519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.477051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.499431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:47.500708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:47.509427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1234/2422] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:47.513659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.524723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd244d0-991e-4ec5-bfa6-d22664cf50bc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.529295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.529889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.530162 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.530429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.531069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:47.531364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.532978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.545738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1189/2423] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:47.550295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.560829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3144-a314-4af1-abc4-c4b9422f640c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.565742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.566336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.566612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.566879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.567504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.569478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.597114 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1235/2424] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:47 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:47.602056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.611786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e44e5-c37d-4077-9308-f82c266f91f1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.666963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.667602 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.667884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.668156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.668811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.670718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.692232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1190/2425] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:47 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:26:47.696759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.706841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4fa5-b51a-45a0-9f30-3f01673fd8b1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.712263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.712896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.713191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.713460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.714093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.715703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.725447 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1236/2426] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:47.729829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.739615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18a5e-2083-4ff8-8447-dbc69e838bed admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.744470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52764f-ed72-4256-b224-6a7102594694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.745086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52764f-ed72-4256-b224-6a7102594694 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.745364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52764f-ed72-4256-b224-6a7102594694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.745634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52764f-ed72-4256-b224-6a7102594694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.746280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52764f-ed72-4256-b224-6a7102594694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.747867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52764f-ed72-4256-b224-6a7102594694 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.758909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1191/2427] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:26:47.762900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.773268 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aab463-eae6-4353-a5e2-f56d010e8779 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.778273 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.778904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.779178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.779451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] PATH_INFO: `/v3/projects/ba38400e752c4d8c92b0d181e37d0e38/users/f8529e86c1074467bf932f4eedf1bb58/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.797252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba38400e752c4d8c92b0d181e37d0e38, user_id=f8529e86c1074467bf932f4eedf1bb58, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.799921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.813553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1237/2428] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:47 2022] PUT /identity/v3/projects/ba38400e752c4d8c92b0d181e37d0e38/users/f8529e86c1074467bf932f4eedf1bb58/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:47.825433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.825719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.825993 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.853882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] MFA Rules not processed for user `f8529e86c1074467bf932f4eedf1bb58`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:47.855087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:47.917742 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1192/2429] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:47.928841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.931073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:47.988315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee027f1-56f1-4d59-8656-e9610d9397ff admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.992475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287bf4-2f42-4a6e-9547-fb66f762e80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.993118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287bf4-2f42-4a6e-9547-fb66f762e80d service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.993409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287bf4-2f42-4a6e-9547-fb66f762e80d service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.993661 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287bf4-2f42-4a6e-9547-fb66f762e80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.001913 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287bf4-2f42-4a6e-9547-fb66f762e80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:48.003317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287bf4-2f42-4a6e-9547-fb66f762e80d service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:48.012971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1238/2430] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:48.034561 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:48.066682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:48.098172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8d86-6673-4076-8e15-e2069ddf365e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:48.102749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:48.103369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.103642 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.103912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] PATH_INFO: `/v3/users/f8529e86c1074467bf932f4eedf1bb58` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.105042 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8529e86c1074467bf932f4eedf1bb58)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:48.106966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:48.152429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8529e86c1074467bf932f4eedf1bb58'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.159943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8529e86c1074467bf932f4eedf1bb58'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.160666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8529e86c1074467bf932f4eedf1bb58'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.161353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8529e86c1074467bf932f4eedf1bb58'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.169446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8529e86c1074467bf932f4eedf1bb58'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.187667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1193/2431] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:48 2022] DELETE /identity/v3/users/f8529e86c1074467bf932f4eedf1bb58 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:48.191924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.192206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.192479 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.212993 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:48.214186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:48.245726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:48.275914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1239/2432] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:48.286007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:48.288035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:48.348527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8069a-2d70-48dc-89fa-65eb4bb74ca0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:48.353649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc94ac-d912-4af4-9312-d73ec2cfdec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:48.354256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc94ac-d912-4af4-9312-d73ec2cfdec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.354529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc94ac-d912-4af4-9312-d73ec2cfdec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.354798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc94ac-d912-4af4-9312-d73ec2cfdec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.364741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc94ac-d912-4af4-9312-d73ec2cfdec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:48.366313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc94ac-d912-4af4-9312-d73ec2cfdec9 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:48.376082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1194/2433] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:48.654258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:48.655957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:48.675714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c00d-d99b-407b-aa05-18b7e5874420 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:48.681615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:48.682222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.682494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.682778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] PATH_INFO: `/v3/projects/ba38400e752c4d8c92b0d181e37d0e38` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.684497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba38400e752c4d8c92b0d181e37d0e38)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:48.686735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:48.738292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba38400e752c4d8c92b0d181e37d0e38', 'request_id': 'req-b149689e-d4c6-4067-9b21-de8ac058a1ce'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.748309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba38400e752c4d8c92b0d181e37d0e38', 'request_id': 'req-b149689e-d4c6-4067-9b21-de8ac058a1ce'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.758300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba38400e752c4d8c92b0d181e37d0e38', 'request_id': 'req-b149689e-d4c6-4067-9b21-de8ac058a1ce'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.769715 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] The token cache is being invalidate because project ba38400e752c4d8c92b0d181e37d0e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:48.770052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.770681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b149689e-d4c6-4067-9b21-de8ac058a1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:48.772415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1240/2434] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:48 2022] DELETE /identity/v3/projects/ba38400e752c4d8c92b0d181e37d0e38 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:48.777763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.778572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.778846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.800896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:48.801905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:48.858762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:48.874182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1195/2435] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:48.881887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.882694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.882986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.903213 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:48.904410 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:48.912493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1241/2436] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:48.920364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:48.930191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600ef9-0e78-43a1-97e6-23aee8634769 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:48.934707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:48.935297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.935569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.935833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.936461 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:48.936795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:48.938368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:48.950498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1196/2437] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:48.954885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:48.964627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d447-db54-4509-9781-1daf651d40a0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:48.970341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:48.970989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:48.971321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:48.971592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:48.972253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:48.974222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:49.000587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1242/2438] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:48 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:49.004729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:49.015815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d9a8b-711c-4540-8c83-bf49404ce1fe admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:49.073091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:49.073610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:49.073884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:49.074154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:49.074777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:49.076691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:49.098348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1197/2439] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:49 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:49.102346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:49.112393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb91d29-1377-4398-a9fc-541ed453b754 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:49.117544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:49.118128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:49.118401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:49.118665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:49.119314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:49.120926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:49.130656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1243/2440] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:49.135359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:49.145401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0b160-4ba3-4779-b3a4-16435a701d80 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:49.150348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194745-c4b5-4eb4-8eff-4a6822f7ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:49.150933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194745-c4b5-4eb4-8eff-4a6822f7ad33 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:49.151212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194745-c4b5-4eb4-8eff-4a6822f7ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:49.151485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194745-c4b5-4eb4-8eff-4a6822f7ad33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:49.152120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194745-c4b5-4eb4-8eff-4a6822f7ad33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:49.153733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194745-c4b5-4eb4-8eff-4a6822f7ad33 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:49.164362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1198/2441] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:26:49.168436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:49.178459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd38637-7f6f-489a-a97d-ae7af0d357e4 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:49.183630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:49.184261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:49.184534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:49.184830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] PATH_INFO: `/v3/projects/d7c439d021384a479fe7908b218fa358/users/918754e17c904d749f20dded27becb7c/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:49.199528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c439d021384a479fe7908b218fa358, user_id=918754e17c904d749f20dded27becb7c, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:49.202436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:49.215473 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1244/2442] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:49 2022] PUT /identity/v3/projects/d7c439d021384a479fe7908b218fa358/users/918754e17c904d749f20dded27becb7c/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:49.226256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:49.226563 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:49.226839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:49.254571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] MFA Rules not processed for user `918754e17c904d749f20dded27becb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:49.255772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:49.318445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1199/2443] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:49.329877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:49.331558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:49.387140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b8a6-8183-4ff5-93e1-a2205ca020a3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:49.390730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e510-5241-48af-a6b6-daf0e0b9fdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:49.391316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e510-5241-48af-a6b6-daf0e0b9fdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:49.391587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e510-5241-48af-a6b6-daf0e0b9fdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:49.391856 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e510-5241-48af-a6b6-daf0e0b9fdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:49.400077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526e510-5241-48af-a6b6-daf0e0b9fdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:49.401517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526e510-5241-48af-a6b6-daf0e0b9fdb7 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:49.406050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:49.410932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1245/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:54.832865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:54.882776 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:54.897732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967858ce-02af-4a59-9857-90bdc187ab77 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:54.902376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:54.903004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:54.903277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:54.903546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] PATH_INFO: `/v3/users/918754e17c904d749f20dded27becb7c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:54.904761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918754e17c904d749f20dded27becb7c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:54.906682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:54.957677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918754e17c904d749f20dded27becb7c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:54.966106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918754e17c904d749f20dded27becb7c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:54.966774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918754e17c904d749f20dded27becb7c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:54.967380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918754e17c904d749f20dded27becb7c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:54.974510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918754e17c904d749f20dded27becb7c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:54.996017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1200/2445] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:54 2022] DELETE /identity/v3/users/918754e17c904d749f20dded27becb7c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:55.000432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd9a89-cda1-48e1-af04-da69a4eafc59 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.000935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd9a89-cda1-48e1-af04-da69a4eafc59 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.001087 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd9a89-cda1-48e1-af04-da69a4eafc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.020064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4bdd9a89-cda1-48e1-af04-da69a4eafc59 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:55.021302 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4bdd9a89-cda1-48e1-af04-da69a4eafc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.084130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1246/2446] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:55.094443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.096161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.155207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648aa92-b260-4035-aaba-003ab0965347 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.158968 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.159570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.159850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.160136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.169704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.171129 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.181609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1201/2447] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:55.352187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead8bd-0383-4d80-bbc1-cb7e31cae497 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.352485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead8bd-0383-4d80-bbc1-cb7e31cae497 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.352789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead8bd-0383-4d80-bbc1-cb7e31cae497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.372776 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3eead8bd-0383-4d80-bbc1-cb7e31cae497 None None] MFA Rules not processed for user `a38be80ef1854cb3aeaa5ca40ed043f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:55.373999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3eead8bd-0383-4d80-bbc1-cb7e31cae497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.431435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1247/2448] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:55.464520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.466557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.483434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4bb9-8149-4183-b1b4-541441b86cc2 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.495189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.495830 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.496237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.496656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] PATH_INFO: `/v3/projects/d7c439d021384a479fe7908b218fa358` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.497990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c439d021384a479fe7908b218fa358)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.500158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.559291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c439d021384a479fe7908b218fa358', 'request_id': 'req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:55.564882 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c439d021384a479fe7908b218fa358', 'request_id': 'req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:55.572868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c439d021384a479fe7908b218fa358', 'request_id': 'req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:55.574104 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:55.586097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] The token cache is being invalidate because project d7c439d021384a479fe7908b218fa358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:55.586585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:55.587480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0e4e1e88-5938-4c36-98ab-0fb4c180e8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:55.589047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1202/2449] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:55 2022] DELETE /identity/v3/projects/d7c439d021384a479fe7908b218fa358 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:55.595325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.595610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.595886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.619468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:55.621373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.687928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1248/2450] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:55.696821 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.697185 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.697529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.717227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:55.718432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.727021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1203/2451] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:55.731274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.741012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32bb8-4047-4060-b581-f837deb72fa2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.746351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.746950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.747228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.747498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.748141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:55.748445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.750083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.762751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1249/2452] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:55.767054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.777052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac68223-1d9b-493f-ad18-039f781cbc10 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.781676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.782336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.782615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.782880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.783531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.785474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.830110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1204/2453] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:55 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:55.831295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.842323 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc47da-d5c0-460b-9acf-d04a6c863c2e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.873566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:55.900866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.901471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.901747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.902033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.902644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.904619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.929930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1250/2454] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:55 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:26:55.931150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.941556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8fd8d-89b9-4e6a-b264-98fa39d56c3d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.947082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.947712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.947988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.948256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.948931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.950557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.961283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1205/2455] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:55.965336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.975498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90900511-e7ce-4ff8-9ac2-644008461dfa admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.980284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c8b7c-b021-4939-8a10-45bcefbaa3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.980912 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8b7c-b021-4939-8a10-45bcefbaa3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.981188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8b7c-b021-4939-8a10-45bcefbaa3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.981458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8b7c-b021-4939-8a10-45bcefbaa3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.982088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c8b7c-b021-4939-8a10-45bcefbaa3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.983670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c8b7c-b021-4939-8a10-45bcefbaa3f3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.994782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1251/2456] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:55.999216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:56.010005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2871-9cfe-4b06-aee8-760d94609bcf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:56.014639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:56.015281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:56.015552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:56.015823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] PATH_INFO: `/v3/projects/0aa5205b5a024ea98015b2d3fbd19883/users/c8092aa3721e4258bc59a0ca54eb2b46/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:56.030962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa5205b5a024ea98015b2d3fbd19883, user_id=c8092aa3721e4258bc59a0ca54eb2b46, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:56.033643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:56.048159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1206/2457] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:55 2022] PUT /identity/v3/projects/0aa5205b5a024ea98015b2d3fbd19883/users/c8092aa3721e4258bc59a0ca54eb2b46/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:26:56.054176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84511b-28a5-40bf-818d-888a77c0e0d0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:56.054176 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84511b-28a5-40bf-818d-888a77c0e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:56.054640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84511b-28a5-40bf-818d-888a77c0e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:56.076700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-8c84511b-28a5-40bf-818d-888a77c0e0d0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:56.078191 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-8c84511b-28a5-40bf-818d-888a77c0e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:56.149451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1252/2458] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:56.159871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:56.162376 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:56.229791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd156a-dbb1-49b0-ae26-75031188a4bf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:56.238747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:56.239358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:56.239629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:56.239893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:56.250903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:56.252932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:56.263406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1207/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:56.898940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505b89-67e1-46b5-92ad-3ec15c22d0cd None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:56.899224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505b89-67e1-46b5-92ad-3ec15c22d0cd None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:56.899497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505b89-67e1-46b5-92ad-3ec15c22d0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:56.934840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-85505b89-67e1-46b5-92ad-3ec15c22d0cd None None] MFA Rules not processed for user `c8092aa3721e4258bc59a0ca54eb2b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:56.936048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-85505b89-67e1-46b5-92ad-3ec15c22d0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:57.009077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1253/2460] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:57.023795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:57.026383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:57.099256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665d416-7a96-41b6-ae92-f9f0c7b6f5df service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:57.104036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:57.104955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:57.105229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:57.105499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:57.115663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:57.117597 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:57.127834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1208/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:58.531277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9107-091e-43fb-9a77-15b88abca1a5 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:58.532218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9107-091e-43fb-9a77-15b88abca1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:58.532711 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9107-091e-43fb-9a77-15b88abca1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:58.554531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5ecc9107-091e-43fb-9a77-15b88abca1a5 None None] MFA Rules not processed for user `c8092aa3721e4258bc59a0ca54eb2b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:58.556055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5ecc9107-091e-43fb-9a77-15b88abca1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:58.563090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1254/2462] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:26:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:07.123970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:08.548838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:30.136528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:30.138524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:30.212158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247a81-68f1-4a1d-beb7-03f78ab84d69 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:30.217650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:30.218251 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:30.218527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:30.218798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:30.220489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:30.276232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:30.277844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:30.286599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1209/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:32.331600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dec01-b6e8-4cf4-a748-03c6644624f9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:32.332109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dec01-b6e8-4cf4-a748-03c6644624f9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:32.332215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dec01-b6e8-4cf4-a748-03c6644624f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:32.352392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b62dec01-b6e8-4cf4-a748-03c6644624f9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:32.353646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b62dec01-b6e8-4cf4-a748-03c6644624f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:32.361603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1255/2464] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:32.383624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:32.385029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:32.399875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859acf-d26b-4d7a-846a-283e2c966142 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:32.405340 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:32.405977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:32.406248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:32.406511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:32.414853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:32.416410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:32.425767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1210/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:36.401371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c93f-9f34-4936-9199-e35410735505 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:36.401849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c93f-9f34-4936-9199-e35410735505 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:36.401957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c93f-9f34-4936-9199-e35410735505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:36.421755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4d29c93f-9f34-4936-9199-e35410735505 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:36.422983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4d29c93f-9f34-4936-9199-e35410735505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:36.431676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1256/2466] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:36.455444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:36.466872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021c5fd-46ae-4820-8020-fd7617ca2f81 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:36.472250 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:36.472868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:36.473173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:36.473449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:36.482139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:36.483692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:36.494712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1211/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:40.677717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4603-f128-4b2f-a491-bd35b3395fb1 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:40.678246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4603-f128-4b2f-a491-bd35b3395fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:40.678246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4603-f128-4b2f-a491-bd35b3395fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:40.698684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2aef4603-f128-4b2f-a491-bd35b3395fb1 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:40.699871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2aef4603-f128-4b2f-a491-bd35b3395fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:40.707535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1257/2468] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:40.744531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:40.755775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea2211-eae3-47b2-b841-377fe27c61ae service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:40.762030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:40.762612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:40.762889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:40.763158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:40.771103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:40.772699 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:40.783013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1212/2469] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:43.776626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c095e-b6c0-45cc-a075-de3d5545ddce None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:43.777132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c095e-b6c0-45cc-a075-de3d5545ddce None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:43.777246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c095e-b6c0-45cc-a075-de3d5545ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:43.796840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-0f8c095e-b6c0-45cc-a075-de3d5545ddce None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:43.798027 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0f8c095e-b6c0-45cc-a075-de3d5545ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:43.806943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1258/2470] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:43.830139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:43.842234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74032-71df-4792-85aa-7e43b0ca7a16 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:43.847820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:43.848404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:43.848735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:43.849005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:43.858041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:43.859611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:43.869401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1213/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:47.976481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5268-5677-4e28-ad73-f9bcb1ce409b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:47.977354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5268-5677-4e28-ad73-f9bcb1ce409b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:47.977636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f5268-5677-4e28-ad73-f9bcb1ce409b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:47.997057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b78f5268-5677-4e28-ad73-f9bcb1ce409b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:47.998254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b78f5268-5677-4e28-ad73-f9bcb1ce409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:48.006266 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1259/2472] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:48.031485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:48.043450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54509d-7195-4984-b242-3cff24183717 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:48.048944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:48.049492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:48.049764 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:48.050038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:48.058290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:48.059841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:48.069096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1214/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:52.167469 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0998b-0cb8-417b-a812-27c7704ec815 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:52.167974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0998b-0cb8-417b-a812-27c7704ec815 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:52.168069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0998b-0cb8-417b-a812-27c7704ec815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:52.187616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-38c0998b-0cb8-417b-a812-27c7704ec815 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:52.188855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-38c0998b-0cb8-417b-a812-27c7704ec815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:52.196919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1260/2474] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:52.218539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:52.230350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b424b00-afdd-416a-baf5-f92ff2a52e43 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:52.235896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:52.236487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:52.236787 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:52.237059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:52.245152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:52.246717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:52.256061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1215/2475] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:57.703194 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f5e1-ce57-4376-9a34-3064a7dd1869 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:57.704249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f5e1-ce57-4376-9a34-3064a7dd1869 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:57.704891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f5e1-ce57-4376-9a34-3064a7dd1869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:57.739282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-4492f5e1-ce57-4376-9a34-3064a7dd1869 None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:57.740758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4492f5e1-ce57-4376-9a34-3064a7dd1869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:57.821945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1261/2476] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:57.873603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:57.875024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:57.877923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:57.982671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60841-ecad-4c99-96c6-0dc65fe6a414 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:57.987670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b499df-e12e-402c-8a9c-569f62ab6d16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:57.988267 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b499df-e12e-402c-8a9c-569f62ab6d16 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:57.988547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b499df-e12e-402c-8a9c-569f62ab6d16 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:57.988840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b499df-e12e-402c-8a9c-569f62ab6d16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:58.004161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b499df-e12e-402c-8a9c-569f62ab6d16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:58.005780 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b499df-e12e-402c-8a9c-569f62ab6d16 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:58.014654 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1216/2477] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:27:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:28:07.819116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=49 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:08.011409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=52 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:09.166667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc6b2-5f73-4ee9-b326-7c20c804a030 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:09.167161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc6b2-5f73-4ee9-b326-7c20c804a030 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:09.167284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc6b2-5f73-4ee9-b326-7c20c804a030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:09.186279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-bc9cc6b2-5f73-4ee9-b326-7c20c804a030 None None] MFA Rules not processed for user `c8092aa3721e4258bc59a0ca54eb2b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:09.187474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-bc9cc6b2-5f73-4ee9-b326-7c20c804a030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:09.194254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1262/2478] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:15.052917 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d54a9-8316-48b5-9a1f-a5ff458400e3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.053427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d54a9-8316-48b5-9a1f-a5ff458400e3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.053592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d54a9-8316-48b5-9a1f-a5ff458400e3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.056206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1217/2479] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:28:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:28:15.063832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231a2d9-7ba6-48a1-b217-1c7dbd852a32 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.064346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231a2d9-7ba6-48a1-b217-1c7dbd852a32 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.064346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231a2d9-7ba6-48a1-b217-1c7dbd852a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.129714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-d231a2d9-7ba6-48a1-b217-1c7dbd852a32 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:15.131116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d231a2d9-7ba6-48a1-b217-1c7dbd852a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:15.160712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1263/2480] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:15.182894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d54a9-8316-48b5-9a1f-a5ff458400e3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:15.184646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-393d54a9-8316-48b5-9a1f-a5ff458400e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:15.260359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d54a9-8316-48b5-9a1f-a5ff458400e3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:15.264344 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c352b7-710f-436b-b51b-377b6e5d523a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:15.264982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c352b7-710f-436b-b51b-377b6e5d523a service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.265261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c352b7-710f-436b-b51b-377b6e5d523a service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.265568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c352b7-710f-436b-b51b-377b6e5d523a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.277954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c352b7-710f-436b-b51b-377b6e5d523a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:15.279043 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c352b7-710f-436b-b51b-377b6e5d523a service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:15.290832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1218/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:15.370718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f007eef-78a1-4d31-b72d-3a1755b671b0 None None] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.371032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f007eef-78a1-4d31-b72d-3a1755b671b0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.371280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f007eef-78a1-4d31-b72d-3a1755b671b0 None None] PATH_INFO: `/` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.372632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1264/2482] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:28:15.377598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc38c8-f825-4c24-8b18-60876fa1de91 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.378140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc38c8-f825-4c24-8b18-60876fa1de91 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.378572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc38c8-f825-4c24-8b18-60876fa1de91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.431990 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-50cc38c8-f825-4c24-8b18-60876fa1de91 None None] MFA Rules not processed for user `15c36ce12e5b4f25848137a9dc590f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:15.433970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-50cc38c8-f825-4c24-8b18-60876fa1de91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:15.442338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1219/2483] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:28:15.455962 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f007eef-78a1-4d31-b72d-3a1755b671b0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:15.480719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f007eef-78a1-4d31-b72d-3a1755b671b0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:15.484817 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad0349-c3f7-4ad7-acde-6b210b059003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:15.485667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad0349-c3f7-4ad7-acde-6b210b059003 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.486065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad0349-c3f7-4ad7-acde-6b210b059003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.486428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad0349-c3f7-4ad7-acde-6b210b059003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.496697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad0349-c3f7-4ad7-acde-6b210b059003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:15.498237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad0349-c3f7-4ad7-acde-6b210b059003 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:15.511145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1265/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:15.627595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0abc2-4d85-4f37-9cf3-8fea176fb51b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.627891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0abc2-4d85-4f37-9cf3-8fea176fb51b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.628152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0abc2-4d85-4f37-9cf3-8fea176fb51b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.630268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1220/2485] 10.222.0.25 () {54 vars in 921 bytes} [Sun Aug 7 18:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:28:15.636214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eae64b-6696-4767-a89b-5050de276301 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.636904 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eae64b-6696-4767-a89b-5050de276301 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.637398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eae64b-6696-4767-a89b-5050de276301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.658974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-17eae64b-6696-4767-a89b-5050de276301 None None] MFA Rules not processed for user `099e4db05ff34c9bad67022f4484c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:15.660330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-17eae64b-6696-4767-a89b-5050de276301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:15.671299 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1266/2486] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Aug 7 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:15.684964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0abc2-4d85-4f37-9cf3-8fea176fb51b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:15.705330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0abc2-4d85-4f37-9cf3-8fea176fb51b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:15.709585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:15.711498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:15.711934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:15.712375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:15.724200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:15.725679 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:15.737140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1221/2487] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:28:20.880106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:20.880590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:20.880684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:20.900842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:20.902066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:20.910792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1267/2488] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Aug 7 18:28:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:20.923807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:20.937657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d937b-e908-41ac-aea4-39df1fcbc43a service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:20.942907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630cb95-dc88-428f-87d9-d99ac3aa9510 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:20.943500 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630cb95-dc88-428f-87d9-d99ac3aa9510 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:20.944049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630cb95-dc88-428f-87d9-d99ac3aa9510 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:20.944323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630cb95-dc88-428f-87d9-d99ac3aa9510 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:20.957542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630cb95-dc88-428f-87d9-d99ac3aa9510 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:20.960177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630cb95-dc88-428f-87d9-d99ac3aa9510 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:20.970401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1222/2489] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:28:30.895101 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=39 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:30.966223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=46 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:40.558995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:40.569352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4891c-f211-4c89-b462-acd640bdec8d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:40.573568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:40.574160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:40.574432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:40.574723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:40.576384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:40.611472 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:40.612973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:40.631795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1268/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:41.548224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8b7c-f86c-488e-aaad-cad6346a65dd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:41.548832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8b7c-f86c-488e-aaad-cad6346a65dd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:41.549137 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8b7c-f86c-488e-aaad-cad6346a65dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:41.571632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-02bd8b7c-f86c-488e-aaad-cad6346a65dd None None] MFA Rules not processed for user `52b6f0f0ede94e629574bc502166e36b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:41.573052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-02bd8b7c-f86c-488e-aaad-cad6346a65dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:41.580266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1223/2491] 10.222.0.25 () {58 vars in 967 bytes} [Sun Aug 7 18:28:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:41.595460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:41.608115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920437eb-2205-43e2-b6d4-da77b5b549c8 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:41.613967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb23346704d74ab8aea1a295ab75cde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:41.614626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:41.614857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:41.615128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:41.624814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:41.626395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:41.640722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1269/2492] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Aug 7 18:28:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:28:43.792728 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:43.793585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:43.794048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:43.850921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:43.852223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:43.870750 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1224/2493] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:43.891292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:43.905960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458157b-0b54-4b49-a9c7-657906c73e71 service swift] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:43.917574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:43.919684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:43.920227 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:43.920730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:43.934450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:43.937622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:43.949852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1270/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:44.136148 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.138154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:44.153998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf0f2d-0f90-4d67-9cea-376f531514d6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.158732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.159382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.159663 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.159931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] PATH_INFO: `/v3/users/21b60f931d1948eb953e14ccee92da2a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.161388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b60f931d1948eb953e14ccee92da2a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.163476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.218161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b60f931d1948eb953e14ccee92da2a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.224956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b60f931d1948eb953e14ccee92da2a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.225575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b60f931d1948eb953e14ccee92da2a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.226187 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b60f931d1948eb953e14ccee92da2a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.233583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5e955c5-3911-4175-bebd-0bdefe6d9108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b60f931d1948eb953e14ccee92da2a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.253555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1225/2495] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:44 2022] DELETE /identity/v3/users/21b60f931d1948eb953e14ccee92da2a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:44.446481 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.457990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f76b1-976f-42c3-a353-1af33c41edbe service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.517297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.518013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.518293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.518563 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] PATH_INFO: `/v3/projects/c5b6e918eede4a8ead6fbb53a7c29a0d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.519718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b6e918eede4a8ead6fbb53a7c29a0d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.521665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.569253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b6e918eede4a8ead6fbb53a7c29a0d', 'request_id': 'req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.575537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b6e918eede4a8ead6fbb53a7c29a0d', 'request_id': 'req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.583378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b6e918eede4a8ead6fbb53a7c29a0d', 'request_id': 'req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.594848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] The token cache is being invalidate because project c5b6e918eede4a8ead6fbb53a7c29a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:28:44.595137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.595845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-57715e38-e1b0-43de-8b7d-1d0f0a8ca00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:44.597381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1271/2496] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:44 2022] DELETE /identity/v3/projects/c5b6e918eede4a8ead6fbb53a7c29a0d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:44.602226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.602677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.603345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.631001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:44.632499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:44.695505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1226/2497] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:44.703765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.704131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.704503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.724848 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:44.726089 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:44.734641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1272/2498] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:44.738806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.748637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6385ee-e283-4963-934f-6b55efc97fc8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.753146 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.753774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.754050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.754315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.754945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:28:44.755354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.756994 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.768358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1227/2499] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:28:44.772476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.782182 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abfcc4-591e-4a5d-8e80-c4a255290634 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.786703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.787283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.787555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.787823 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.788440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.790651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.806797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:44.821212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1273/2500] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:44 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:44.825629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.835587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872617-8a3d-468b-88d0-49d72e52570e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.857028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:44.893466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.893996 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.894270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.894541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.895163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.897109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.918007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1228/2501] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:44 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:44.922151 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.932229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acdaf1-f966-4339-ab1a-2b71a47f3e99 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.936829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.937419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.937700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.937965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.938589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.940238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.951168 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1274/2502] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:44.955044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.965553 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668f35d-b4f3-41db-a851-4b12621a3ecc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:44.970198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3ec50-03b5-4ae5-8a0c-ee99b4a0e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:44.970786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3ec50-03b5-4ae5-8a0c-ee99b4a0e810 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:44.971073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3ec50-03b5-4ae5-8a0c-ee99b4a0e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:44.971346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3ec50-03b5-4ae5-8a0c-ee99b4a0e810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:44.971978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3ec50-03b5-4ae5-8a0c-ee99b4a0e810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:44.973589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3ec50-03b5-4ae5-8a0c-ee99b4a0e810 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:44.983865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1229/2503] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:44.987851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:44.997975 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46c0ab-5760-4c50-9125-119e294c834d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.002593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.003232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.003504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.003773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] PATH_INFO: `/v3/projects/b8d7e11a8b734c69b9dcaad03fe798cb/users/b47e2e58515e417294cb1e6d4705a5ae/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.018773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d7e11a8b734c69b9dcaad03fe798cb, user_id=b47e2e58515e417294cb1e6d4705a5ae, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.021426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.035083 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1275/2504] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:44 2022] PUT /identity/v3/projects/b8d7e11a8b734c69b9dcaad03fe798cb/users/b47e2e58515e417294cb1e6d4705a5ae/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:45.047470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.047756 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.048029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.075154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] MFA Rules not processed for user `b47e2e58515e417294cb1e6d4705a5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:45.076375 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:45.140955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1230/2505] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:45.145459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.207218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ff944-f570-4d96-804d-e7dc7198ac58 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.211815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.212407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.213422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.213701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.214308 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.216208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.246024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1276/2506] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:45 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:45.247203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.257932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7d01-7f64-44fa-b86e-cdd92c98ddeb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.313801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.314395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.314674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.314946 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.315557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.317541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.338847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1231/2507] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:45 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:45.342884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.353149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae48c9-2b7a-47c8-b3c3-0f412fb92420 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.357641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.358246 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.358519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.358787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.359415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.361020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.371782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1277/2508] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:45.375802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.386370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e31bf-bf4d-4415-bd57-0499d79baaad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.390985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.391624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.391906 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.392183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] PATH_INFO: `/v3/projects/26892291946a4b7d90929f3a004e8abc/users/a37e199973ac4053a8e1c279698a2058/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.407064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26892291946a4b7d90929f3a004e8abc, user_id=a37e199973ac4053a8e1c279698a2058, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.409672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.418374 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:45.424684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1232/2509] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:45 2022] PUT /identity/v3/projects/26892291946a4b7d90929f3a004e8abc/users/a37e199973ac4053a8e1c279698a2058/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:28:45.428516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.439039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570ebf-afa1-417c-a262-43aabda234f3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.496804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13546da-1989-4f33-b121-6e1c68181020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.497438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13546da-1989-4f33-b121-6e1c68181020 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.497760 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13546da-1989-4f33-b121-6e1c68181020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.498026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13546da-1989-4f33-b121-6e1c68181020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.498706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13546da-1989-4f33-b121-6e1c68181020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.500608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13546da-1989-4f33-b121-6e1c68181020 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.511400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1278/2510] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:45.515550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.526272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceaf77-8fbc-469f-a258-a1e0e98844d2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.530984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.531639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.531920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.532195 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] PATH_INFO: `/v3/projects/26892291946a4b7d90929f3a004e8abc/users/a37e199973ac4053a8e1c279698a2058/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.534149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26892291946a4b7d90929f3a004e8abc, user_id=a37e199973ac4053a8e1c279698a2058, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.536860 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.548074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1233/2511] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:45 2022] PUT /identity/v3/projects/26892291946a4b7d90929f3a004e8abc/users/a37e199973ac4053a8e1c279698a2058/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:45.558779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.559069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.559346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.587381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] MFA Rules not processed for user `a37e199973ac4053a8e1c279698a2058`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:45.588631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:45.606796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:45.659806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1279/2512] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:45.671404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.673316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:45.751280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a4ae-4e37-47d5-ac5e-8b8b4c11ebf0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.754978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1287d87-0d71-4125-9970-ce8c9e5a01c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.755578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1287d87-0d71-4125-9970-ce8c9e5a01c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.755855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1287d87-0d71-4125-9970-ce8c9e5a01c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.756126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1287d87-0d71-4125-9970-ce8c9e5a01c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.765533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1287d87-0d71-4125-9970-ce8c9e5a01c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.766948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1287d87-0d71-4125-9970-ce8c9e5a01c1 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.777065 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1234/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:28:45.852126 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:45.861742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19f1c-d2d2-47e3-8849-946531d53adf None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:45.865337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:45.865926 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:45.866205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:45.866475 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:45.923193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:45.924614 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:45.933721 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1280/2514] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:48.090680 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:48.091242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:48.091345 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:48.110891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:48.112122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:48.174644 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1235/2515] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:48.194992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:48.196399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:48.288414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ee28e-8b55-4745-ad3c-2f8eca702d33 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:48.296080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d3c2d-6593-4ade-a6d5-0e32a5f19bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:48.297019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d3c2d-6593-4ade-a6d5-0e32a5f19bdc service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:48.297455 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d3c2d-6593-4ade-a6d5-0e32a5f19bdc service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:48.298491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d3c2d-6593-4ade-a6d5-0e32a5f19bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:48.311161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d3c2d-6593-4ade-a6d5-0e32a5f19bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:48.313012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d3c2d-6593-4ade-a6d5-0e32a5f19bdc service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:48.329438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1281/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:48.660887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:48.671337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80dd81-c5a2-4f6d-bbdf-2e71052b272a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:48.676474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:48.677082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:48.677354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:48.677615 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] PATH_INFO: `/v3/users/b47e2e58515e417294cb1e6d4705a5ae` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:48.678717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47e2e58515e417294cb1e6d4705a5ae)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:48.680646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:48.731170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47e2e58515e417294cb1e6d4705a5ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:48.738645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47e2e58515e417294cb1e6d4705a5ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:48.739473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47e2e58515e417294cb1e6d4705a5ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:48.740223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47e2e58515e417294cb1e6d4705a5ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:48.748795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47e2e58515e417294cb1e6d4705a5ae'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:48.750033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:48.770410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1236/2517] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:48 2022] DELETE /identity/v3/users/b47e2e58515e417294cb1e6d4705a5ae => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:48.775117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:48.775487 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:48.775829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:48.795542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:48.796969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:48.835893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:48.863947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1282/2518] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:48.873931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:48.875978 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:48.934244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93668bc-7cf5-4988-a42f-c0e74cafe30a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:48.937763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:48.938366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:48.938639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:48.938905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:48.949387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:48.950386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:48.960749 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1237/2519] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:49.267502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:49.269147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:49.289646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a68119-0978-49ef-bd27-f7bb2aa21c38 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:49.295032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:49.295668 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:49.295946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:49.296216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] PATH_INFO: `/v3/projects/b8d7e11a8b734c69b9dcaad03fe798cb` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:49.297381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d7e11a8b734c69b9dcaad03fe798cb)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:49.299310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:49.351720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d7e11a8b734c69b9dcaad03fe798cb', 'request_id': 'req-5c3121c8-5317-4686-81af-0a6f64bf4172'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.357822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d7e11a8b734c69b9dcaad03fe798cb', 'request_id': 'req-5c3121c8-5317-4686-81af-0a6f64bf4172'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.365354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d7e11a8b734c69b9dcaad03fe798cb', 'request_id': 'req-5c3121c8-5317-4686-81af-0a6f64bf4172'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.378088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] The token cache is being invalidate because project b8d7e11a8b734c69b9dcaad03fe798cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:28:49.378383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.379037 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.380530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1283/2520] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:49 2022] DELETE /identity/v3/projects/b8d7e11a8b734c69b9dcaad03fe798cb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:49.384777 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:49.394366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b00f-d8ea-418a-8ef6-c39d7858d588 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:49.458481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:49.459126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:49.459404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:49.459676 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] PATH_INFO: `/v3/users/a37e199973ac4053a8e1c279698a2058` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:49.460858 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37e199973ac4053a8e1c279698a2058)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:49.463300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:49.512474 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37e199973ac4053a8e1c279698a2058'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.519691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37e199973ac4053a8e1c279698a2058'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.520400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37e199973ac4053a8e1c279698a2058'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.521071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37e199973ac4053a8e1c279698a2058'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.528281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-de085556-7d2d-4c09-8ed6-afc46c49e33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37e199973ac4053a8e1c279698a2058'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.546048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1238/2521] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:49 2022] DELETE /identity/v3/users/a37e199973ac4053a8e1c279698a2058 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:49.820978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:49.829233 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:49.848940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3121c8-5317-4686-81af-0a6f64bf4172 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:49.907054 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:49.907675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:49.907949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:49.908225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] PATH_INFO: `/v3/projects/26892291946a4b7d90929f3a004e8abc` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:49.909361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26892291946a4b7d90929f3a004e8abc)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:49.911251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:49.957279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26892291946a4b7d90929f3a004e8abc', 'request_id': 'req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.963502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26892291946a4b7d90929f3a004e8abc', 'request_id': 'req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.967205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:49.970768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26892291946a4b7d90929f3a004e8abc', 'request_id': 'req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.984947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] The token cache is being invalidate because project 26892291946a4b7d90929f3a004e8abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:28:49.985230 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.985873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1308f4ed-6853-4191-9fc8-9ea1ab26ac5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:49.987340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1284/2522] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:49 2022] DELETE /identity/v3/projects/26892291946a4b7d90929f3a004e8abc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:49.993312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:49.993540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:49.993918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.001616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:50.015835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:50.017084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:50.077700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1239/2523] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:50.085674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.085952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.086220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.107159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:50.108364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:50.116141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1285/2524] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:50.120505 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.129977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd400ee-6580-420b-bcf9-376b62c188a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.135086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.135672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.135943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.136207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.136868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:28:50.137167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.138743 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.151069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1240/2525] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:28:50.155301 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.164654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07817a-2630-4785-8dd9-f2640f151236 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.169446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.170029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.170303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.170569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.171188 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.173103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.199836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1286/2526] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:28:50.203942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.214415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5714-85f1-4874-ae47-434e332d1ffe admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.277622 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.278228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.278503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.278793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.279406 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.281328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.306307 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1241/2527] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:28:50.308113 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.319295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffef4-0759-4b31-ac0d-d135019fbc87 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.326657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.327572 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.328085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.328543 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.329444 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.331234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.351865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1287/2528] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:50.356089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.366511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ce8e9-b785-4c70-a24c-5183bf803fcf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.372324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed42f3-83ad-43ac-9931-f1ffcc9aea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.373130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed42f3-83ad-43ac-9931-f1ffcc9aea4b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.373507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed42f3-83ad-43ac-9931-f1ffcc9aea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.373848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed42f3-83ad-43ac-9931-f1ffcc9aea4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.374496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed42f3-83ad-43ac-9931-f1ffcc9aea4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.376554 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed42f3-83ad-43ac-9931-f1ffcc9aea4b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.392216 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1242/2529] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:50.393681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.407064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5cf6-92d0-4087-84b8-8741c2b9732f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.411854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.412510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.412822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.413100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] PATH_INFO: `/v3/projects/a19b70744d4449ff8494a2e323207b5c/users/15ec1769174e43c9bcd9ea06048797de/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.430526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19b70744d4449ff8494a2e323207b5c, user_id=15ec1769174e43c9bcd9ea06048797de, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.433981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.447914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1288/2530] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:50 2022] PUT /identity/v3/projects/a19b70744d4449ff8494a2e323207b5c/users/15ec1769174e43c9bcd9ea06048797de/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:50.459328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.459612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.459887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.488312 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] MFA Rules not processed for user `15ec1769174e43c9bcd9ea06048797de`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:50.489566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:50.551660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:50.558624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1243/2531] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:50.562998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.624773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40651693-c2a4-47f4-8cea-b974ea86678e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.629349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.629947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.630224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.630492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.631115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.633033 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.660221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1289/2532] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:50.664529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.675503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5f637-d5ea-456f-8fff-f789ee1db25e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.731850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.732449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.732755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.733026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.733650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.735582 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.755316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1244/2533] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:28:50.759555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.769944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29d63-fb96-488b-accf-7d880a54fc89 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.774783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.775866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.776140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.776432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.777088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.778666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.789211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1290/2534] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:50.794025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.804032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653630-fb57-4dc2-992b-0778bbfffc69 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.808579 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.809239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.809511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.809792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] PATH_INFO: `/v3/projects/79ded6d49e5a4535b4b23928aadd078c/users/2fc8df5b2bb24aa19dca53d4be376f8a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.825103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ded6d49e5a4535b4b23928aadd078c, user_id=2fc8df5b2bb24aa19dca53d4be376f8a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.827729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.841182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1245/2535] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:50 2022] PUT /identity/v3/projects/79ded6d49e5a4535b4b23928aadd078c/users/2fc8df5b2bb24aa19dca53d4be376f8a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:50.845071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.855688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645867b2-2a26-4efa-847f-91342cd4a2d6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.912635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8939b17-f71b-4fc4-8b39-c625c7813bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.913345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939b17-f71b-4fc4-8b39-c625c7813bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.913626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939b17-f71b-4fc4-8b39-c625c7813bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.913900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939b17-f71b-4fc4-8b39-c625c7813bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.914777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8939b17-f71b-4fc4-8b39-c625c7813bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.916887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8939b17-f71b-4fc4-8b39-c625c7813bbd admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.918906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:50.927490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1291/2536] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:50.931588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:50.941627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3430d5d-76ec-4b93-91b6-8d381f7248db admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:50.946201 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:50.947335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.947608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.947877 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] PATH_INFO: `/v3/projects/79ded6d49e5a4535b4b23928aadd078c/users/2fc8df5b2bb24aa19dca53d4be376f8a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.949842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ded6d49e5a4535b4b23928aadd078c, user_id=2fc8df5b2bb24aa19dca53d4be376f8a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:50.952469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:50.962298 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1246/2537] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:50 2022] PUT /identity/v3/projects/79ded6d49e5a4535b4b23928aadd078c/users/2fc8df5b2bb24aa19dca53d4be376f8a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:50.973346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4161-31c5-417e-9a1c-7ba44470c145 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.973657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4161-31c5-417e-9a1c-7ba44470c145 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.973929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4161-31c5-417e-9a1c-7ba44470c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.000942 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-da9b4161-31c5-417e-9a1c-7ba44470c145 None None] MFA Rules not processed for user `2fc8df5b2bb24aa19dca53d4be376f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:51.002148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-da9b4161-31c5-417e-9a1c-7ba44470c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.070788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1292/2538] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:28:51.086141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:51.090900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.150062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87130e-f3e1-4a9c-93cd-6e26215070d7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:51.154537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:51.155156 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:51.155456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:51.155724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.172331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:51.173829 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:51.183852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1247/2539] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:51.192785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:51.193013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:51.193439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.215217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:51.216451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.253093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:51.282267 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1293/2540] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:51.305425 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:51.306863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.308616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:51.320545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d1b30-d56d-4f33-add9-4ad0ca841b0d service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:51.325627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:51.326264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:51.326567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:51.326837 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] PATH_INFO: `/v3/users/15ec1769174e43c9bcd9ea06048797de` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.327963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ec1769174e43c9bcd9ea06048797de)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:51.329909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:51.383485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ec1769174e43c9bcd9ea06048797de'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:51.389223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc77173-e10f-4868-b766-306b048c4c62 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:51.398132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ec1769174e43c9bcd9ea06048797de'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:51.398132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ec1769174e43c9bcd9ea06048797de'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:51.398132 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ec1769174e43c9bcd9ea06048797de'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:51.402335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:51.402335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:51.402335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:51.402335 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.403884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.404048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a81341a2-e1f7-451e-9ccb-7ec2507d8ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ec1769174e43c9bcd9ea06048797de'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:51.413503 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:51.416791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:51.422704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1248/2541] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:51 2022] DELETE /identity/v3/users/15ec1769174e43c9bcd9ea06048797de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:51.427689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:51.428019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:51.428607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.429717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1294/2542] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:28:51.453516 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:51.454727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.522275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1249/2543] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:28:51.537742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:51.539573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.552742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:51.610177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ca37-4cf4-4777-9c69-854dbb7d42ad service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:51.660892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:51.661471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:51.661742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:51.662008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:51.671331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:51.672822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:51.682272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1295/2544] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:51.969853 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:51.971455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:51.999191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25eba04-eda1-40da-ba10-8fbe026f26dd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:52.004520 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:52.005377 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.005731 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.006139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] PATH_INFO: `/v3/projects/a19b70744d4449ff8494a2e323207b5c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.007451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19b70744d4449ff8494a2e323207b5c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:52.010020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:52.064482 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19b70744d4449ff8494a2e323207b5c', 'request_id': 'req-2a667acd-9cc6-4810-b8ea-0da13ee5973c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.070270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19b70744d4449ff8494a2e323207b5c', 'request_id': 'req-2a667acd-9cc6-4810-b8ea-0da13ee5973c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.078635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19b70744d4449ff8494a2e323207b5c', 'request_id': 'req-2a667acd-9cc6-4810-b8ea-0da13ee5973c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.080824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:52.092545 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] The token cache is being invalidate because project a19b70744d4449ff8494a2e323207b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:28:52.092861 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.093497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.094964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1250/2545] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:51 2022] DELETE /identity/v3/projects/a19b70744d4449ff8494a2e323207b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:52.098966 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:52.109750 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343a41-cebd-4702-a64b-3073d40072c8 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:52.176295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:52.177026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.177480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.177812 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] PATH_INFO: `/v3/users/2fc8df5b2bb24aa19dca53d4be376f8a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.179468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc8df5b2bb24aa19dca53d4be376f8a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:52.181670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:52.231119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc8df5b2bb24aa19dca53d4be376f8a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.238138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc8df5b2bb24aa19dca53d4be376f8a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.238820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc8df5b2bb24aa19dca53d4be376f8a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.239426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc8df5b2bb24aa19dca53d4be376f8a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.247382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-29afb1c0-5cc8-4af0-827d-7414eaf397b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc8df5b2bb24aa19dca53d4be376f8a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.253063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:52.269154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1296/2546] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:52 2022] DELETE /identity/v3/users/2fc8df5b2bb24aa19dca53d4be376f8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:52.546675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:52.548524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:52.563706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a667acd-9cc6-4810-b8ea-0da13ee5973c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:52.621449 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:52.622001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.622277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.622552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] PATH_INFO: `/v3/projects/79ded6d49e5a4535b4b23928aadd078c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.623649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ded6d49e5a4535b4b23928aadd078c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:52.625577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:52.671732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ded6d49e5a4535b4b23928aadd078c', 'request_id': 'req-b95c2f6f-3989-4708-a8e1-0983efafd6fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.677531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ded6d49e5a4535b4b23928aadd078c', 'request_id': 'req-b95c2f6f-3989-4708-a8e1-0983efafd6fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.685290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ded6d49e5a4535b4b23928aadd078c', 'request_id': 'req-b95c2f6f-3989-4708-a8e1-0983efafd6fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.696241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] The token cache is being invalidate because project 79ded6d49e5a4535b4b23928aadd078c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:28:52.696529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.697433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b95c2f6f-3989-4708-a8e1-0983efafd6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:52.699103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1251/2547] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:52 2022] DELETE /identity/v3/projects/79ded6d49e5a4535b4b23928aadd078c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:52.703958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.704451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.704598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.724334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:52.725564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:52.786601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1297/2548] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:52.795296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.796084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.796084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.815619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:52.816835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:52.824793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1252/2549] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:52.828995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:52.839241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7af1e-a445-4e1f-b814-5a4076049aee None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:52.843834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:52.844423 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.844734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.845005 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.845646 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:28:52.845943 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:52.847574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:52.859691 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1298/2550] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:28:52.863762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:52.874241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961788-0c30-462d-8db4-536a776c1bec None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:52.878782 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:52.879367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.879636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.879903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.880507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:52.882419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:52.910624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1253/2551] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:52 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:52.915007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:52.925923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2ffe-9b87-4b1f-8716-240d551e950c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:52.984166 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:52.984835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:52.985118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:52.985396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:52.986261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:52.988240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:53.010334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1299/2552] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:52 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:53.014426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:53.025627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfab6-fe96-4525-bd59-1bccf1afe90a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:53.031625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:53.032265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:53.032542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:53.032844 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:53.033489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:53.035126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:53.046696 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1254/2553] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:53.051269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:53.063451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4418bc-bec9-4b4f-87ac-842db8b9b515 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:53.068100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75db28a-93d3-4f9a-babe-21c378814903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:53.068725 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db28a-93d3-4f9a-babe-21c378814903 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:53.069012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db28a-93d3-4f9a-babe-21c378814903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:53.069285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db28a-93d3-4f9a-babe-21c378814903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:53.069974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db28a-93d3-4f9a-babe-21c378814903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:53.071546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db28a-93d3-4f9a-babe-21c378814903 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:53.082412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1300/2554] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:53.086842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:53.097716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60769b0-20c9-49e3-bc3a-2b6b67accaa7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:53.102299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:53.102962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:53.104009 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:53.104302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] PATH_INFO: `/v3/projects/f55a6953d25a45aca39a4551349ab443/users/b47bd29f04b14c9f979f3de756cc899e/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:53.121568 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55a6953d25a45aca39a4551349ab443, user_id=b47bd29f04b14c9f979f3de756cc899e, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:53.124200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:53.137633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1255/2555] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:53 2022] PUT /identity/v3/projects/f55a6953d25a45aca39a4551349ab443/users/b47bd29f04b14c9f979f3de756cc899e/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:53.142677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0cae-49b4-498e-b1cf-485326309ca5 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:53.142961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0cae-49b4-498e-b1cf-485326309ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:53.143259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0cae-49b4-498e-b1cf-485326309ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:53.162969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ec9c0cae-49b4-498e-b1cf-485326309ca5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:53.164440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ec9c0cae-49b4-498e-b1cf-485326309ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:53.220056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:53.240354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1301/2556] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:53.250897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:53.252778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:53.280892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:53.316395 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32a8fe-a0c0-43d3-8337-3fc8da0a2dcf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:53.320041 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:53.320677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:53.320955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:53.321244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:53.331523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:53.333004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:53.344140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1256/2557] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:54.241639 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a86f87-7109-4a9b-a583-e83cf328a1e3 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.242143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a86f87-7109-4a9b-a583-e83cf328a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.242256 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a86f87-7109-4a9b-a583-e83cf328a1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.273476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-11a86f87-7109-4a9b-a583-e83cf328a1e3 None None] MFA Rules not processed for user `b47bd29f04b14c9f979f3de756cc899e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:54.275278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-11a86f87-7109-4a9b-a583-e83cf328a1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:54.354569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1302/2558] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:54.359290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.370032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f838be-6c07-49b7-a986-4fe46bdf6577 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.375082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.375985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.376252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.376527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.377196 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.377486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.377879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.378332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.379543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.403277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:54.404764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:54.415581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1303/2559] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:28:54.420476 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1257/2560] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:28:54.424517 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.436902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6482b-21d0-4795-b8bb-55ed209ef70d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.439021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.442018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:54.520183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.520183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.523206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.523206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.523206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.523710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.542639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64bc3d-1f2f-4cc1-8065-1dc691c7cd95 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.549950 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.550744 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.551571 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.551702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1304/2561] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:54 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:54.551849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.555652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.569546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.569964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337afdc-2e0f-4815-84e2-18896e61bb1b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.573496 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.575883 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.576478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.576815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.577096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.577658 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.579512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.589902 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1258/2562] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:54.595547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1305/2563] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:28:54.607225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.626026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e76f-4589-4912-91dd-8a0711fa3de3 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.631044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.631788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.632124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.632604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] PATH_INFO: `/v3/projects/9c78c464b644417c871392c893d5529e/users/8be7547e7ee8464e83c8f2b026c31833/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.651035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c78c464b644417c871392c893d5529e, user_id=8be7547e7ee8464e83c8f2b026c31833, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.654302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.669446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1259/2564] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:54 2022] PUT /identity/v3/projects/9c78c464b644417c871392c893d5529e/users/8be7547e7ee8464e83c8f2b026c31833/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:54.673632 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.686846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db223e-ff34-4f7d-b5c5-d60948f523f8 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.742599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:54.753072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1fc9d-dc3f-424a-b94d-6ab541114716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.753675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fc9d-dc3f-424a-b94d-6ab541114716 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.753951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fc9d-dc3f-424a-b94d-6ab541114716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.754219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fc9d-dc3f-424a-b94d-6ab541114716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.754849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1fc9d-dc3f-424a-b94d-6ab541114716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.756790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1fc9d-dc3f-424a-b94d-6ab541114716 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.767712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1306/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:54.771901 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:54.782907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aab7a-1990-4823-a69e-6c599f9a4e2b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:54.787709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d8b54-1312-4215-839d-ecdef012a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:54.788357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d8b54-1312-4215-839d-ecdef012a852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:54.788674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d8b54-1312-4215-839d-ecdef012a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:54.788947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d8b54-1312-4215-839d-ecdef012a852 admin admin] PATH_INFO: `/v3/projects/9c78c464b644417c871392c893d5529e/users/8be7547e7ee8464e83c8f2b026c31833/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:54.791929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d8b54-1312-4215-839d-ecdef012a852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c78c464b644417c871392c893d5529e, user_id=8be7547e7ee8464e83c8f2b026c31833, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:54.794592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d8b54-1312-4215-839d-ecdef012a852 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:54.806799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1260/2566] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:54 2022] PUT /identity/v3/projects/9c78c464b644417c871392c893d5529e/users/8be7547e7ee8464e83c8f2b026c31833/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:55.438058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:55.438562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:55.438660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:55.468683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] MFA Rules not processed for user `8be7547e7ee8464e83c8f2b026c31833`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:55.470065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:55.544200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1307/2567] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:55.555898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:55.556549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:55.556549 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:55.577266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] MFA Rules not processed for user `b47bd29f04b14c9f979f3de756cc899e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:55.578488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:55.626355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:55.638836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1261/2568] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:55.650630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:55.652026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:55.725031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a703efa-96e4-4511-9fab-700c45aee20d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:55.730955 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828b374-c5a1-47b5-a6a5-b59dd828c28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:55.731553 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b374-c5a1-47b5-a6a5-b59dd828c28e service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:55.731832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b374-c5a1-47b5-a6a5-b59dd828c28e service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:55.732105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b374-c5a1-47b5-a6a5-b59dd828c28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:55.739707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828b374-c5a1-47b5-a6a5-b59dd828c28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:55.741333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828b374-c5a1-47b5-a6a5-b59dd828c28e service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:55.751310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1308/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:55.849732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:55.905049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051f13-560e-49a6-a580-43a25524a932 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:55.908518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:55.909141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:55.909413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:55.909678 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:55.911368 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:55.975284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:55.976745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:55.986916 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1262/2570] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:58.591297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:58.591297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:58.592272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:58.614318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:58.615561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:58.626208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1309/2571] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Aug 7 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:58.655346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:58.669271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa547e5-5849-4c03-bf66-74f178720b37 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:58.681770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:58.682569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:58.683372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:58.683610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:58.693159 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:58.695007 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:58.706796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1263/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:59.963900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:59.965329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:59.977811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71ac5c-c781-418b-94fa-ff19be4d38e6 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:59.983830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:59.984325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:59.984627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:59.984897 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] PATH_INFO: `/v3/users/a38be80ef1854cb3aeaa5ca40ed043f8` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:59.986218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38be80ef1854cb3aeaa5ca40ed043f8)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:59.988105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.039555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38be80ef1854cb3aeaa5ca40ed043f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.041575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:00.048806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38be80ef1854cb3aeaa5ca40ed043f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.049940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38be80ef1854cb3aeaa5ca40ed043f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.050573 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38be80ef1854cb3aeaa5ca40ed043f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.057836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d115165f-254e-4149-8116-f39f52e52d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38be80ef1854cb3aeaa5ca40ed043f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.077076 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1310/2573] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:59 2022] DELETE /identity/v3/users/a38be80ef1854cb3aeaa5ca40ed043f8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:00.269794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.303294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77b281-6e35-4195-8db8-4ba8f63f9e67 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.380390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.381179 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.381455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.381723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] PATH_INFO: `/v3/projects/3abdce763e8d419785dba0b74b63b5d2` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.382894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abdce763e8d419785dba0b74b63b5d2)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.385513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.427397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:00.439480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abdce763e8d419785dba0b74b63b5d2', 'request_id': 'req-147c43ae-c394-4b6f-9387-1236da3f2337'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.444943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abdce763e8d419785dba0b74b63b5d2', 'request_id': 'req-147c43ae-c394-4b6f-9387-1236da3f2337'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.453533 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abdce763e8d419785dba0b74b63b5d2', 'request_id': 'req-147c43ae-c394-4b6f-9387-1236da3f2337'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.467801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] The token cache is being invalidate because project 3abdce763e8d419785dba0b74b63b5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:00.468092 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.468791 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-147c43ae-c394-4b6f-9387-1236da3f2337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.470292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1264/2574] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:00 2022] DELETE /identity/v3/projects/3abdce763e8d419785dba0b74b63b5d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:00.475465 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.475793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.476105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.498220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:00.499967 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:00.576207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1311/2575] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:00.584805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.585090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.585360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.608401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:00.609894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:00.620459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1265/2576] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:00.624784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.641051 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6df69-c13e-4aaa-853f-1756479efd82 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.645885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.646728 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.647075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.647417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.648275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:00.648868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.650560 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.665013 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1312/2577] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:00.670076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.683140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424db64c-6002-418f-a559-ce79ef33b8dc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.687817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.688418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.688718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.688991 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.689628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.691547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.722779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1266/2578] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:00.727184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.738362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7167a-fcf2-4a15-bc40-835547c5e291 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.804080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.804739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.805086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.805428 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.806692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.808723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.835813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1313/2579] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:00.840252 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.851559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3aa55-d662-41de-a023-e8dc6c291b5e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.857215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.857817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.858095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.858369 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.859034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.860712 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.877412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1267/2580] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:00.883122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.895277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657316f-bc1a-4031-9bfe-dfac73a15813 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.900303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e237ce-cbb3-4ac0-a2b7-1cef1b268549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.900997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e237ce-cbb3-4ac0-a2b7-1cef1b268549 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.901374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e237ce-cbb3-4ac0-a2b7-1cef1b268549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.901923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e237ce-cbb3-4ac0-a2b7-1cef1b268549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.902717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e237ce-cbb3-4ac0-a2b7-1cef1b268549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.904697 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e237ce-cbb3-4ac0-a2b7-1cef1b268549 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.919918 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1314/2581] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:00.924348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.936981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76fcc1-901f-4f1f-9ee1-d8f796dca62f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.942255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.942926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.943206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.943481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] PATH_INFO: `/v3/projects/315edd4dbfd44e93a66fa49e3a805947/users/ffe013958ef949d7b36b4ddb15b512e3/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.965583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315edd4dbfd44e93a66fa49e3a805947, user_id=ffe013958ef949d7b36b4ddb15b512e3, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.968608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.985212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1268/2582] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:00 2022] PUT /identity/v3/projects/315edd4dbfd44e93a66fa49e3a805947/users/ffe013958ef949d7b36b4ddb15b512e3/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:00.996879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.997445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.997445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.027599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] MFA Rules not processed for user `ffe013958ef949d7b36b4ddb15b512e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:01.029032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:01.052399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:01.105035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1315/2583] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:01.109603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.177238 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9443-1627-47bb-b3d0-e69afffdd180 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.182324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.182927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.183203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.183470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.184098 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.186031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.217481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1269/2584] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:01.218522 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.230125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ebfd-46db-4605-8fc9-2028226be94d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.294384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.295050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.295331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.295622 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.296240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.298270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.320815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1316/2585] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:01.325019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.335207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3645-37c7-4fa4-83c4-dbf5104e34bd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.341258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.341576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.341841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.342229 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.342737 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.344342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.356645 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1270/2586] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:01.360878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.372414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145efe-d5de-415b-a21b-3e6bf858d653 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.377274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.377923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.378244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.378579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] PATH_INFO: `/v3/projects/698b47705eea4c8d952b14ae8eb1a5bd/users/bc0c3b87331c4b4a914466d0b0dae6f8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.396361 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=698b47705eea4c8d952b14ae8eb1a5bd, user_id=bc0c3b87331c4b4a914466d0b0dae6f8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.399175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.413595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1317/2587] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:01 2022] PUT /identity/v3/projects/698b47705eea4c8d952b14ae8eb1a5bd/users/bc0c3b87331c4b4a914466d0b0dae6f8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:01.418039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.428024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab666e-d1c3-4525-b297-dce70c9763f4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.457313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:01.484938 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dbcdb-a4f9-4072-9473-bfdab306a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.485538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbcdb-a4f9-4072-9473-bfdab306a792 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.485814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbcdb-a4f9-4072-9473-bfdab306a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.486082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbcdb-a4f9-4072-9473-bfdab306a792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.486713 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dbcdb-a4f9-4072-9473-bfdab306a792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.488306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dbcdb-a4f9-4072-9473-bfdab306a792 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.499026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1271/2588] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:01.503156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.514207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ef98c-3d7e-415c-bb71-764d55f3db2c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.518935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.519586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.519866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.520141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] PATH_INFO: `/v3/projects/698b47705eea4c8d952b14ae8eb1a5bd/users/bc0c3b87331c4b4a914466d0b0dae6f8/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.522097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698b47705eea4c8d952b14ae8eb1a5bd, user_id=bc0c3b87331c4b4a914466d0b0dae6f8, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.524836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.534887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1318/2589] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:01 2022] PUT /identity/v3/projects/698b47705eea4c8d952b14ae8eb1a5bd/users/bc0c3b87331c4b4a914466d0b0dae6f8/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:01.546037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.546320 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.546595 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.574321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] MFA Rules not processed for user `bc0c3b87331c4b4a914466d0b0dae6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:01.575467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:01.641675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1272/2590] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:01.652754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.656675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:01.717836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f2544-4ec0-4f08-b9c0-543fe96699d2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.721439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bcc7b-2358-4fdf-a09c-5ae1c7aea783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.722026 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcc7b-2358-4fdf-a09c-5ae1c7aea783 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.722298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcc7b-2358-4fdf-a09c-5ae1c7aea783 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.722564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcc7b-2358-4fdf-a09c-5ae1c7aea783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.731826 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcc7b-2358-4fdf-a09c-5ae1c7aea783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.733279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcc7b-2358-4fdf-a09c-5ae1c7aea783 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.742670 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1319/2591] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:01.924535 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.989336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf07d-898c-4fc0-815b-f3230467a048 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.994415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.995073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.995347 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.995616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] PATH_INFO: `/v3/users/ffe013958ef949d7b36b4ddb15b512e3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.996762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe013958ef949d7b36b4ddb15b512e3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.998656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.046121 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe013958ef949d7b36b4ddb15b512e3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.054168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe013958ef949d7b36b4ddb15b512e3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.054800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe013958ef949d7b36b4ddb15b512e3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.055394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe013958ef949d7b36b4ddb15b512e3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.057786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:02.064636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe013958ef949d7b36b4ddb15b512e3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.081745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1273/2592] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:01 2022] DELETE /identity/v3/users/ffe013958ef949d7b36b4ddb15b512e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:02.086277 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.086785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.086890 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.106342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:02.107460 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:02.119097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:02.166602 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1320/2593] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:02.176372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:02.177848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:02.235641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24868484-10a3-4772-a30c-801eba5ca758 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.239333 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.239933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.240211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.240486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.249746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.251174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.261184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1274/2594] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:02.586641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:02.589157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:02.601170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aef1a-a829-444b-a3cc-d0bd97c6a911 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.606363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.606997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.607272 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.607679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] PATH_INFO: `/v3/projects/315edd4dbfd44e93a66fa49e3a805947` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.608822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=315edd4dbfd44e93a66fa49e3a805947)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.610795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.658650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315edd4dbfd44e93a66fa49e3a805947', 'request_id': 'req-fcb589f3-00e2-4606-b958-627463a124fe'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.663954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315edd4dbfd44e93a66fa49e3a805947', 'request_id': 'req-fcb589f3-00e2-4606-b958-627463a124fe'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.672315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315edd4dbfd44e93a66fa49e3a805947', 'request_id': 'req-fcb589f3-00e2-4606-b958-627463a124fe'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.684554 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] The token cache is being invalidate because project 315edd4dbfd44e93a66fa49e3a805947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:02.684861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.685518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.686964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1321/2595] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:02 2022] DELETE /identity/v3/projects/315edd4dbfd44e93a66fa49e3a805947 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:02.690909 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:02.702112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe03df-eac3-47af-9496-c69ea1ab5a52 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.757810 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.758436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.758709 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.759012 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] PATH_INFO: `/v3/users/bc0c3b87331c4b4a914466d0b0dae6f8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.760811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0c3b87331c4b4a914466d0b0dae6f8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.762717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.812311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0c3b87331c4b4a914466d0b0dae6f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.820514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0c3b87331c4b4a914466d0b0dae6f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.821205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0c3b87331c4b4a914466d0b0dae6f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.821899 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0c3b87331c4b4a914466d0b0dae6f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.829002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-962c1b9a-10ed-4769-a9aa-63301a032302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0c3b87331c4b4a914466d0b0dae6f8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.841702 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:02.849775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1275/2596] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:02 2022] DELETE /identity/v3/users/bc0c3b87331c4b4a914466d0b0dae6f8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:03.122370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.123931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.139105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb589f3-00e2-4606-b958-627463a124fe admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.203248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.203893 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.204172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.204441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] PATH_INFO: `/v3/projects/698b47705eea4c8d952b14ae8eb1a5bd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.205647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] RBAC: Authorizing `identity:delete_project(project_id=698b47705eea4c8d952b14ae8eb1a5bd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.207576 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.256698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:03.261735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698b47705eea4c8d952b14ae8eb1a5bd', 'request_id': 'req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.269617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698b47705eea4c8d952b14ae8eb1a5bd', 'request_id': 'req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.280152 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698b47705eea4c8d952b14ae8eb1a5bd', 'request_id': 'req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.292288 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] The token cache is being invalidate because project 698b47705eea4c8d952b14ae8eb1a5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:03.292626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.293281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4d065dd2-bdcc-4b9f-8d88-b8d3ba8a888f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.294906 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1322/2597] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:03 2022] DELETE /identity/v3/projects/698b47705eea4c8d952b14ae8eb1a5bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:03.299847 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.300154 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.300421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.320625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:03.322452 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.384863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1276/2598] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:03.393606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.393907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.394181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.415125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:03.416402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.424386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1323/2599] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:03.428541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.438985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d703-00c7-4553-802b-43b4fbea8aa5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.443912 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.444529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.444862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.445199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.445875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:03.446244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.448643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.460414 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1277/2600] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:03.465073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.474340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10e6ef-4bf7-4ec3-8bd6-7e24603169f2 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.479606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.480202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.480474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.480770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.481398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.483311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.512886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1324/2601] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:03.517107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.529564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae8e0c-81df-42ce-8026-af0d5fcb029f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.596954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.597683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.597963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.598227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.598911 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.600827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.626592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1278/2602] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:03.630685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.642902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08d02-9f38-46f7-a74d-86d86d69a61a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.648365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.649019 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.649296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.649615 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.650486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.652439 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.665868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1325/2603] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:03.670366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.683721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ec5f-fc2f-45bf-8445-1ac3847b32ae admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.688719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d28447-8ec0-43ff-a400-af26912971ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.689332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d28447-8ec0-43ff-a400-af26912971ab admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.689624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d28447-8ec0-43ff-a400-af26912971ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.689862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d28447-8ec0-43ff-a400-af26912971ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.690530 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d28447-8ec0-43ff-a400-af26912971ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.692125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d28447-8ec0-43ff-a400-af26912971ab admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.704400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1279/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:03.708530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.718867 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add55e3-361c-405c-b1b8-5a49d07a358b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.723438 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.724073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.724349 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.724655 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] PATH_INFO: `/v3/projects/a7530af1aa814eae98fdca8b779366de/users/acdd0992dfbc464498f661b02e6cbafd/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.739950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7530af1aa814eae98fdca8b779366de, user_id=acdd0992dfbc464498f661b02e6cbafd, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.742751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.757953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1326/2605] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:03 2022] PUT /identity/v3/projects/a7530af1aa814eae98fdca8b779366de/users/acdd0992dfbc464498f661b02e6cbafd/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:03.768203 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.768485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.768784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.797604 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] MFA Rules not processed for user `acdd0992dfbc464498f661b02e6cbafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:03.798822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.845812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:03.864255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1280/2606] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:03.869577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.930761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de0d2e-efaf-4232-984f-24f788e64feb admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.936129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.936758 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.937036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.937298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.937930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.939838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.972436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1327/2607] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:03.976353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.990673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c93e61-0aef-4d4f-8c00-c886931a4d90 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.053783 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.054390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.054671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.054939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.055562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.057681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.078812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1281/2608] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:04.083791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.094930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff338-7324-415f-9f26-e288c8eb7c53 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.099499 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.100096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.100372 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.100675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.101306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.103459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.113881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1328/2609] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:04.117980 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.127826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869bc7f-b321-48b3-b90d-7e085be80dcd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.132364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.133038 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.133317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.133589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] PATH_INFO: `/v3/projects/6329ef4283bf4e0eb83bffc79c403e2f/users/d89f6407208349178ae4605bf08ddb5a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.148178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6329ef4283bf4e0eb83bffc79c403e2f, user_id=d89f6407208349178ae4605bf08ddb5a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.151419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.164467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1282/2610] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:04 2022] PUT /identity/v3/projects/6329ef4283bf4e0eb83bffc79c403e2f/users/d89f6407208349178ae4605bf08ddb5a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:04.169061 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.179045 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7e2d4-f6c8-45b0-afd5-65a9a5d26182 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.219382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:04.237608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df29a6e-e3f2-4817-b836-f3e4a0912105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.238226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29a6e-e3f2-4817-b836-f3e4a0912105 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.238502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29a6e-e3f2-4817-b836-f3e4a0912105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.238769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29a6e-e3f2-4817-b836-f3e4a0912105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.239387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29a6e-e3f2-4817-b836-f3e4a0912105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.241001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29a6e-e3f2-4817-b836-f3e4a0912105 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.250659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1329/2611] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:04.254762 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.264873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05dbbc-033e-47bd-9b6a-36a51edea985 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.269364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.269998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.270272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.270538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] PATH_INFO: `/v3/projects/6329ef4283bf4e0eb83bffc79c403e2f/users/d89f6407208349178ae4605bf08ddb5a/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.272410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6329ef4283bf4e0eb83bffc79c403e2f, user_id=d89f6407208349178ae4605bf08ddb5a, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.275592 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.285872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1283/2612] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:04 2022] PUT /identity/v3/projects/6329ef4283bf4e0eb83bffc79c403e2f/users/d89f6407208349178ae4605bf08ddb5a/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:04.298360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.298667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.298936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.326179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] MFA Rules not processed for user `d89f6407208349178ae4605bf08ddb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:04.327387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:04.398136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1330/2613] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:04.413522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.415869 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:04.473356 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1892a-5b32-44f6-a174-3b2f7a9b9539 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.476925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.477522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.477831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.478108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.487158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.488608 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.498355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1284/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:04.840281 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.849480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae6a5-e87a-4cfc-9788-6b67be6cc8ea None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.855201 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89f6407208349178ae4605bf08ddb5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6329ef4283bf4e0eb83bffc79c403e2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.856097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.856097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.856348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.857030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:04.857336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.858920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.871115 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1331/2615] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:04.875531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.885070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca849f6c-c0cd-4e31-ad1d-b5610c4601bd service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.889686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89f6407208349178ae4605bf08ddb5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6329ef4283bf4e0eb83bffc79c403e2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.890279 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.890559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.890859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.891479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.893413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.922437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1285/2616] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:04 2022] POST /identity/v3/projects => generated 353 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:04.926482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.938998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5adc-02d3-4673-a6cd-6981d5a8ff60 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.995279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89f6407208349178ae4605bf08ddb5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6329ef4283bf4e0eb83bffc79c403e2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.995837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.996120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.996398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.997075 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:04.997385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.998997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:05.010973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1332/2617] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:05.049509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:05.060028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3575-6602-436b-bb01-897dedd07393 tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:05.064662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89f6407208349178ae4605bf08ddb5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6329ef4283bf4e0eb83bffc79c403e2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:05.065299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:05.065580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:05.065857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] PATH_INFO: `/v3/projects/fc3ebe5d2296478daf2c948a8cac4499` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:05.066988 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc3ebe5d2296478daf2c948a8cac4499)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:05.068907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:05.092011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:05.124027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3ebe5d2296478daf2c948a8cac4499', 'request_id': 'req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.130513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3ebe5d2296478daf2c948a8cac4499', 'request_id': 'req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.137954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3ebe5d2296478daf2c948a8cac4499', 'request_id': 'req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.153886 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] The token cache is being invalidate because project fc3ebe5d2296478daf2c948a8cac4499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:05.154227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.155006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-76f0d0ed-135c-4203-a510-ca03b0e4d5ce tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.156822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1286/2618] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:05 2022] DELETE /identity/v3/projects/fc3ebe5d2296478daf2c948a8cac4499 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:05.388915 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:05.390722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:05.442451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:05.461565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fefb3d-d1e5-4d5c-826a-15093de4b39a tempest-VolumeQuotaClassesTest-809813756 tempest-VolumeQuotaClassesTest-809813756-project-admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:05.641259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:05.641781 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:05.642053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:05.642318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] PATH_INFO: `/v3/users/acdd0992dfbc464498f661b02e6cbafd` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:05.643415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdd0992dfbc464498f661b02e6cbafd)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:05.645309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:05.690772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdd0992dfbc464498f661b02e6cbafd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.698090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdd0992dfbc464498f661b02e6cbafd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.698732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdd0992dfbc464498f661b02e6cbafd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.699321 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdd0992dfbc464498f661b02e6cbafd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.706351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdd0992dfbc464498f661b02e6cbafd'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:05.723443 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1333/2619] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:05 2022] DELETE /identity/v3/users/acdd0992dfbc464498f661b02e6cbafd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:05.727823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:05.728108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:05.728433 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:05.747296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:05.748502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:05.808281 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1287/2620] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:05.817984 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:05.819419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:05.876609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011123f-29cf-42ec-8616-7c6e92b5afa5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:05.880215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:05.880946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:05.881222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:05.881491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:05.890808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:05.892291 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:05.901964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1334/2621] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:06.258802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:06.260305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:06.272636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7f43-3310-4c76-b007-06acd3edbe4c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:06.277866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:06.278502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:06.278781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:06.279053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] PATH_INFO: `/v3/projects/a7530af1aa814eae98fdca8b779366de` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:06.280176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7530af1aa814eae98fdca8b779366de)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:06.282147 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:06.330153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7530af1aa814eae98fdca8b779366de', 'request_id': 'req-34dd487a-97c4-4aec-b063-7ad96a5b0a90'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.335413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7530af1aa814eae98fdca8b779366de', 'request_id': 'req-34dd487a-97c4-4aec-b063-7ad96a5b0a90'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.342894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7530af1aa814eae98fdca8b779366de', 'request_id': 'req-34dd487a-97c4-4aec-b063-7ad96a5b0a90'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.354244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] The token cache is being invalidate because project a7530af1aa814eae98fdca8b779366de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:06.354527 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.355163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.356677 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1288/2622] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:06 2022] DELETE /identity/v3/projects/a7530af1aa814eae98fdca8b779366de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:06.360636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:06.371212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eb978-f868-4ca2-b4cc-01fb28a4e2f0 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:06.379873 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:06.433771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:06.434404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:06.434679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:06.434948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] PATH_INFO: `/v3/users/d89f6407208349178ae4605bf08ddb5a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:06.436067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89f6407208349178ae4605bf08ddb5a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:06.438064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:06.485136 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89f6407208349178ae4605bf08ddb5a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.492200 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89f6407208349178ae4605bf08ddb5a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.494216 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89f6407208349178ae4605bf08ddb5a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.494811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89f6407208349178ae4605bf08ddb5a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.502788 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-28b7058b-4b1d-4bb1-96ec-7ee2a2d42b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89f6407208349178ae4605bf08ddb5a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.522727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1335/2623] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:06 2022] DELETE /identity/v3/users/d89f6407208349178ae4605bf08ddb5a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:06.799979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:06.801809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:06.817051 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd487a-97c4-4aec-b063-7ad96a5b0a90 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:06.849143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:06.878135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:06.878759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:06.879034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:06.879308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] PATH_INFO: `/v3/projects/6329ef4283bf4e0eb83bffc79c403e2f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:06.880404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6329ef4283bf4e0eb83bffc79c403e2f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:06.882323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:06.928354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6329ef4283bf4e0eb83bffc79c403e2f', 'request_id': 'req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.934472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6329ef4283bf4e0eb83bffc79c403e2f', 'request_id': 'req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.941698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6329ef4283bf4e0eb83bffc79c403e2f', 'request_id': 'req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.953240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] The token cache is being invalidate because project 6329ef4283bf4e0eb83bffc79c403e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:06.953550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.954173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7fc1a1ad-d435-4f11-a28a-c89a2b2e936d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:06.955635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1289/2624] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:06 2022] DELETE /identity/v3/projects/6329ef4283bf4e0eb83bffc79c403e2f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:06.960398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:06.960722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:06.960998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:06.980692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:06.981923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:07.040793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1336/2625] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:07.048441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.048790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.049073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.068546 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:07.069784 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:07.078367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1290/2626] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:07.082431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.091889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce8eb-c13f-4397-b5a0-8ae6bcd3543c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.096580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.097240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.097540 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.097804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.098435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:07.098730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.100297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.115045 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1337/2627] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:07.116059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.126040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1905916-6d7b-4294-ba69-c8eb44a9146a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.130623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.131214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.131488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.131758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.132382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.134964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.162443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1291/2628] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:07.166889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.176825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e2f6c-c916-40c4-bb8a-a383db7229e1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.195832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:07.242185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.242784 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.243060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.243860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.244526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.246474 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.270228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1338/2629] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:07.277657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.289740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d0408-ab22-4afe-859e-124b07a5bdd6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.294564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.295161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.295446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.295719 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.296387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.298040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.308774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1292/2630] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:07.312894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.323952 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d2c02-9812-42fe-83ce-4b0bcb398e73 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.328528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971f84-38fb-4705-995a-fe7e17762cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.329142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971f84-38fb-4705-995a-fe7e17762cac admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.329417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971f84-38fb-4705-995a-fe7e17762cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.329687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971f84-38fb-4705-995a-fe7e17762cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.330317 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971f84-38fb-4705-995a-fe7e17762cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.331894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971f84-38fb-4705-995a-fe7e17762cac admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.342289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1339/2631] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:07.346341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.356862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816c7af-1bc7-4077-a40d-ac86476c08ca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.361458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.362095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.362370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.362641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] PATH_INFO: `/v3/projects/b19cec5cdb024a5a95acc4d773cf4515/users/86c2bed46a4b4111b8f3f4b2b24c3d7b/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.377200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19cec5cdb024a5a95acc4d773cf4515, user_id=86c2bed46a4b4111b8f3f4b2b24c3d7b, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.379805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.392207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1293/2632] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:07 2022] PUT /identity/v3/projects/b19cec5cdb024a5a95acc4d773cf4515/users/86c2bed46a4b4111b8f3f4b2b24c3d7b/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:07.403292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.403609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.403884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.432344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] MFA Rules not processed for user `86c2bed46a4b4111b8f3f4b2b24c3d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:07.433620 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:07.497675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1340/2633] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:07.502607 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.561348 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:07.566967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dce43-28d9-47be-9984-7d581213cc63 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.574014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.574620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.574908 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.575182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.575801 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.577914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.608620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1294/2634] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:07.609791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.620901 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2fa2-7888-43b1-99b5-bf483c387509 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.684523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.685165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.685445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.685716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.686358 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.688262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.713012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1341/2635] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:07.714215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.725700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e9109-b9c9-42bb-9b7e-70405fe5c89e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.731141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.732047 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.732332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.732632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.733297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.734884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.746629 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1295/2636] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:07.751545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.761621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237f6a-ac48-4cff-be8a-f3ed266f62cc admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.766314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.766957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.767239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.767511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] PATH_INFO: `/v3/projects/84e052ac69b747c89be226b5d480cb92/users/957caac1118445ffae7f4816401bd419/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.782684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e052ac69b747c89be226b5d480cb92, user_id=957caac1118445ffae7f4816401bd419, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.785343 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.787746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:07.801186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1342/2637] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:07 2022] PUT /identity/v3/projects/84e052ac69b747c89be226b5d480cb92/users/957caac1118445ffae7f4816401bd419/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:07.805158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.815385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177c847-657b-49fc-afa2-951d1e13bf92 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.872896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ad1c6-a043-4b27-9b2d-4f0e6fa0336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.873499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ad1c6-a043-4b27-9b2d-4f0e6fa0336e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.873779 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ad1c6-a043-4b27-9b2d-4f0e6fa0336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.874052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ad1c6-a043-4b27-9b2d-4f0e6fa0336e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.874682 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ad1c6-a043-4b27-9b2d-4f0e6fa0336e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.876814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ad1c6-a043-4b27-9b2d-4f0e6fa0336e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.886959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1296/2638] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:07.891212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:07.902145 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201fb04-2a21-4059-9642-0a3963abbbe1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:07.907471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:07.908116 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.908392 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.908699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] PATH_INFO: `/v3/projects/84e052ac69b747c89be226b5d480cb92/users/957caac1118445ffae7f4816401bd419/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.910570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e052ac69b747c89be226b5d480cb92, user_id=957caac1118445ffae7f4816401bd419, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:07.913228 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:07.924610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1343/2639] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:07 2022] PUT /identity/v3/projects/84e052ac69b747c89be226b5d480cb92/users/957caac1118445ffae7f4816401bd419/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:07.935803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:07.936117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:07.936394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:07.966664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] MFA Rules not processed for user `957caac1118445ffae7f4816401bd419`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:07.967880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:08.036926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1297/2640] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:08.048391 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:08.050118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:08.109040 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335bb05-c8da-4308-8de1-78e98face842 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:08.112654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:08.113247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:08.113530 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:08.113804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:08.123830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:08.125293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:08.134785 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1344/2641] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:08.182341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:08.183725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:08.195617 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9728f-5b63-4a9b-b012-3bcc10fcbcc9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:08.199623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:08.200214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:08.200488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:08.200856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:08.252482 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:08.262843 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:08.264315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:08.273282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1298/2642] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:10.160644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:10.163532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:10.280714 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a859f9-dbb9-43d4-a3d4-c03607e5f4c4 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:10.287838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:10.288492 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:10.288949 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:10.289502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:10.291304 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:10.303925 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:10.305536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81da6-dd92-4ba4-adbc-01d0bd752ff4 service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:10.316690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1345/2643] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:11.629455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.691872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aa77a-5125-4b95-ac83-efa1b47ff2dd service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.696448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.697122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.697381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.697655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] PATH_INFO: `/v3/users/86c2bed46a4b4111b8f3f4b2b24c3d7b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.698775 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c2bed46a4b4111b8f3f4b2b24c3d7b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.700739 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.752806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c2bed46a4b4111b8f3f4b2b24c3d7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.760087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c2bed46a4b4111b8f3f4b2b24c3d7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.760751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c2bed46a4b4111b8f3f4b2b24c3d7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.761382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c2bed46a4b4111b8f3f4b2b24c3d7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.768165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c2bed46a4b4111b8f3f4b2b24c3d7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.785593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1299/2644] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:11 2022] DELETE /identity/v3/users/86c2bed46a4b4111b8f3f4b2b24c3d7b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:11.791802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.792306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.792844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.816919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:11.818117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.868480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:11.883502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1346/2645] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:11.894435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.895975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.956323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc1176-d93d-423e-ad9e-951e945ab21b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.960180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.960895 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.961271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.962583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.971836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.973291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.983357 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1300/2646] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:12.300887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.302384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:12.327426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9b8ab-f222-40cd-bb57-6fed73a5e6f4 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.346123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.346123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.346123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.346123 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] PATH_INFO: `/v3/projects/b19cec5cdb024a5a95acc4d773cf4515` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.346497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19cec5cdb024a5a95acc4d773cf4515)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.346497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.400791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19cec5cdb024a5a95acc4d773cf4515', 'request_id': 'req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.406930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19cec5cdb024a5a95acc4d773cf4515', 'request_id': 'req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.413889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19cec5cdb024a5a95acc4d773cf4515', 'request_id': 'req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.426206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] The token cache is being invalidate because project b19cec5cdb024a5a95acc4d773cf4515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:12.426493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.427122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.429559 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1347/2647] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:12 2022] DELETE /identity/v3/projects/b19cec5cdb024a5a95acc4d773cf4515 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:12.433306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.443017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bfd54-03aa-4f27-a2cc-544d9d468d37 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.452186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:12.503689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.504316 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.504603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.504898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] PATH_INFO: `/v3/users/957caac1118445ffae7f4816401bd419` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.506046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=957caac1118445ffae7f4816401bd419)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.508035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.561634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957caac1118445ffae7f4816401bd419'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.570849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957caac1118445ffae7f4816401bd419'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.572110 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957caac1118445ffae7f4816401bd419'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.572805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957caac1118445ffae7f4816401bd419'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.580585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eedaf1a6-81ac-4467-8f36-f557927bd1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957caac1118445ffae7f4816401bd419'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.598532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1301/2648] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:12 2022] DELETE /identity/v3/users/957caac1118445ffae7f4816401bd419 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:12.865991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.867523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:12.883683 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98ee46-c09d-48dc-b6d6-3a3f275bccae admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.944986 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.945611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.945886 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.946360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] PATH_INFO: `/v3/projects/84e052ac69b747c89be226b5d480cb92` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.947887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e052ac69b747c89be226b5d480cb92)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.950341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.998202 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e052ac69b747c89be226b5d480cb92', 'request_id': 'req-20eb0920-f200-42f4-baf1-bb9600fb67f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.003759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e052ac69b747c89be226b5d480cb92', 'request_id': 'req-20eb0920-f200-42f4-baf1-bb9600fb67f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.010880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e052ac69b747c89be226b5d480cb92', 'request_id': 'req-20eb0920-f200-42f4-baf1-bb9600fb67f8'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.021643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] The token cache is being invalidate because project 84e052ac69b747c89be226b5d480cb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:13.021927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.022548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-20eb0920-f200-42f4-baf1-bb9600fb67f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.024000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1348/2649] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:12 2022] DELETE /identity/v3/projects/84e052ac69b747c89be226b5d480cb92 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:13.029436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.029947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.030050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.050371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:13.051503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.109228 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1302/2650] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:13.117025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.117306 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.117575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.131766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:13.137789 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:13.140062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.148318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1349/2651] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:13.153205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.162888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4625688-3c6c-4727-ae5e-0972ea51c0f5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.168296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.168925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.169204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.169471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.170114 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:13.170416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.171997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.183494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1303/2652] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:13.187613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.197090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3613866-b61a-40b6-96a5-0c047c319098 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.201659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.202237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.202510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.202779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.203397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.205327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.235102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1350/2653] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:13.239248 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.249511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43519e-8dfb-45d3-bd85-84028f5d744c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.266003 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:13.308576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.309122 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.309401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.309672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.310288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.312197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.332432 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1304/2654] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:13.336545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.347641 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40192a6-1930-4439-9413-8c8f3176545b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.352733 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.353545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.354036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.354348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.355008 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.356621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.367482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1351/2655] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:13.371317 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.384284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080fc27-32df-4330-89ce-221b8fd3bbcf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.388754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077ec4b-4cb2-4231-a9c2-b054ff27c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.389634 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077ec4b-4cb2-4231-a9c2-b054ff27c63b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.390163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077ec4b-4cb2-4231-a9c2-b054ff27c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.390286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077ec4b-4cb2-4231-a9c2-b054ff27c63b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.390817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077ec4b-4cb2-4231-a9c2-b054ff27c63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.392393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077ec4b-4cb2-4231-a9c2-b054ff27c63b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.406818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1305/2656] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:13.408877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.419270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6e2d-e890-4520-a30d-63ffd9e72715 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.437593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.438255 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.438526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.438795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] PATH_INFO: `/v3/projects/8764abeb7c494886b0665a5d2365a505/users/43f72ef31476437bb3074ab23993d214/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.455682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8764abeb7c494886b0665a5d2365a505, user_id=43f72ef31476437bb3074ab23993d214, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.458529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.471700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1352/2657] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:13 2022] PUT /identity/v3/projects/8764abeb7c494886b0665a5d2365a505/users/43f72ef31476437bb3074ab23993d214/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:13.483715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.484053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.484363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.517569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] MFA Rules not processed for user `43f72ef31476437bb3074ab23993d214`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:13.518785 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.605664 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1306/2658] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:13.611314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.689198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a26270-1333-443c-8f5a-b492763461d2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.695157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.695769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.696049 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.696533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.697048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.700408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.738504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1353/2659] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:13.742765 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.744814 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.746657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.753896 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53dcd-a6ca-47a2-af83-12c0b69a1b13 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.818524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.819140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.819485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.819828 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.820689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.821156 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c9af-2b06-4da6-93a6-4947fdf322cd admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.823084 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.824818 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.825411 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.825685 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.825948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.827629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.844522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1307/2660] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:13.848451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.858839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c4692-6d76-46bc-a918-4784ac28af45 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.864099 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.864724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.865004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.865274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.865931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.867673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.878067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:13.878586 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1308/2661] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:13.882467 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.892304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca1c4b-0b3d-47dd-b692-0afadcceb6c1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.897130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c909d-964a-4875-8b2b-30296e1d8ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.897723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c909d-964a-4875-8b2b-30296e1d8ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.897982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c909d-964a-4875-8b2b-30296e1d8ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.898249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c909d-964a-4875-8b2b-30296e1d8ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.898866 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c909d-964a-4875-8b2b-30296e1d8ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.900829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.901297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c909d-964a-4875-8b2b-30296e1d8ff8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.902258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.902746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:13.912137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1354/2662] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:29:14.043959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1309/2663] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:14.047793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.058944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f11f7-6dc1-4154-8790-951273a327ca service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.063809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.064524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.064891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.065224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] PATH_INFO: `/v3/projects/ac765aa84cf34878aebd49f345bb12f5/users/c04915b3be154797b6877ace7d62ac15/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.084450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac765aa84cf34878aebd49f345bb12f5, user_id=c04915b3be154797b6877ace7d62ac15, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.087414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.102251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1355/2664] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:14 2022] PUT /identity/v3/projects/ac765aa84cf34878aebd49f345bb12f5/users/c04915b3be154797b6877ace7d62ac15/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:14.114486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.114766 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.115037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.142797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] MFA Rules not processed for user `c04915b3be154797b6877ace7d62ac15`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:14.144018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.207697 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1310/2665] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:14.212385 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.280853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4f4bb-fc1b-4c67-a9b7-5407b2c1aaa1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.285724 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.286326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.286606 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.286878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.287511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.289681 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.322749 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1356/2666] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:14.326724 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.337556 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8531b1-9c12-46a0-a3f4-19266528a4db None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.398326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.398934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.399444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.400149 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.400532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.402450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.424805 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1311/2667] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:14.428851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.439643 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439820-c647-4667-8110-795fb37957c5 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.444426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.445053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.445325 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.445592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.446244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.448127 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.459283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1357/2668] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:14.463706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.473625 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9568b-0800-4f26-9374-814c0881d351 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.478867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.479544 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.479816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.480083 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] PATH_INFO: `/v3/projects/da29f56e3ed54310a2f7a1f707c77878/users/d4e85b0d12864eeea62833647ae75010/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.495297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da29f56e3ed54310a2f7a1f707c77878, user_id=d4e85b0d12864eeea62833647ae75010, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.498130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.512921 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1312/2669] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:14 2022] PUT /identity/v3/projects/da29f56e3ed54310a2f7a1f707c77878/users/d4e85b0d12864eeea62833647ae75010/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:14.516863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.527808 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1ccd-3ece-495c-8a44-9b2517ddc810 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.585483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d1666-57d8-4722-8908-fa9b771f5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.586153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d1666-57d8-4722-8908-fa9b771f5013 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.586436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d1666-57d8-4722-8908-fa9b771f5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.586745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d1666-57d8-4722-8908-fa9b771f5013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.587544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d1666-57d8-4722-8908-fa9b771f5013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.589210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d1666-57d8-4722-8908-fa9b771f5013 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.599468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1358/2670] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:14.604052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.619091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494d7c4-a05c-43da-afaa-106c23e13841 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.625366 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.626080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.626460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.626839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] PATH_INFO: `/v3/projects/da29f56e3ed54310a2f7a1f707c77878/users/d4e85b0d12864eeea62833647ae75010/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.629172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da29f56e3ed54310a2f7a1f707c77878, user_id=d4e85b0d12864eeea62833647ae75010, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.633086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.645076 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1313/2671] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:14 2022] PUT /identity/v3/projects/da29f56e3ed54310a2f7a1f707c77878/users/d4e85b0d12864eeea62833647ae75010/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:14.655398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.655745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.656085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.684531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] MFA Rules not processed for user `d4e85b0d12864eeea62833647ae75010`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:14.685846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.698580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:14.759830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1359/2672] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:14.772269 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.823944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:14.838232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0a279-0646-4d17-98a5-3e28a5e93484 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.841928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.842464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.842741 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.843013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.852109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.854309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.867324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1314/2673] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:14.908651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.920178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a130040-d7b8-45ca-8650-8fe0203ee71f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.924300 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0ce9-dfbc-49dc-bd81-33f85603ce55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.924965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0ce9-dfbc-49dc-bd81-33f85603ce55 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.925242 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0ce9-dfbc-49dc-bd81-33f85603ce55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.925509 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0ce9-dfbc-49dc-bd81-33f85603ce55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.990914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e0ce9-dfbc-49dc-bd81-33f85603ce55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.992348 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e0ce9-dfbc-49dc-bd81-33f85603ce55 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:15.002332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1360/2674] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:17.935910 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:17.996327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424016d-1698-4f10-b168-0f95b82ca99f service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:18.000904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:18.001524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:18.001827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:18.002095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] PATH_INFO: `/v3/users/43f72ef31476437bb3074ab23993d214` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:18.003190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f72ef31476437bb3074ab23993d214)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:18.005167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:18.050305 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f72ef31476437bb3074ab23993d214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.058720 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f72ef31476437bb3074ab23993d214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.059331 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f72ef31476437bb3074ab23993d214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.060189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f72ef31476437bb3074ab23993d214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.067171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f72ef31476437bb3074ab23993d214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.083794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1315/2675] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:17 2022] DELETE /identity/v3/users/43f72ef31476437bb3074ab23993d214 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:18.088258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:18.088828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:18.088828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:18.108791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:18.109981 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:18.172968 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1361/2676] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:18.183213 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:18.184754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:18.248539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c6efb-19b9-4872-b34b-0743eca7ad83 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:18.252694 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:18.253573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:18.253949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:18.254068 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:18.264128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:18.266136 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:18.281126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1316/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:18.592956 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:18.594591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:18.616262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b996-371b-4ddc-b56e-0cf7bc36eb77 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:18.623803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:18.624468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:18.624780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:18.625056 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] PATH_INFO: `/v3/projects/8764abeb7c494886b0665a5d2365a505` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:18.626210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8764abeb7c494886b0665a5d2365a505)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:18.628103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:18.672496 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:18.676491 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8764abeb7c494886b0665a5d2365a505', 'request_id': 'req-206828da-fa0d-443a-af97-403b81e0711d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.682656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8764abeb7c494886b0665a5d2365a505', 'request_id': 'req-206828da-fa0d-443a-af97-403b81e0711d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.689307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8764abeb7c494886b0665a5d2365a505', 'request_id': 'req-206828da-fa0d-443a-af97-403b81e0711d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.700899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] The token cache is being invalidate because project 8764abeb7c494886b0665a5d2365a505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:18.701211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.701891 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.703352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1362/2678] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:18 2022] DELETE /identity/v3/projects/8764abeb7c494886b0665a5d2365a505 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:18.707389 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:18.712242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:18.719031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c193-3f83-4a40-acfc-0763d686f700 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:18.777029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:18.777646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:18.777918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:18.778186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] PATH_INFO: `/v3/users/c04915b3be154797b6877ace7d62ac15` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:18.779275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04915b3be154797b6877ace7d62ac15)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:18.781207 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:18.828831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04915b3be154797b6877ace7d62ac15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.836283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04915b3be154797b6877ace7d62ac15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.837029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04915b3be154797b6877ace7d62ac15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.837631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04915b3be154797b6877ace7d62ac15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.844945 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04915b3be154797b6877ace7d62ac15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:18.862045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1317/2679] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:18 2022] DELETE /identity/v3/users/c04915b3be154797b6877ace7d62ac15 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:19.141147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:19.142561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:19.160599 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206828da-fa0d-443a-af97-403b81e0711d admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:19.218186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:19.218816 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:19.219094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:19.219369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] PATH_INFO: `/v3/projects/ac765aa84cf34878aebd49f345bb12f5` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:19.220486 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac765aa84cf34878aebd49f345bb12f5)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:19.222396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:19.268254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac765aa84cf34878aebd49f345bb12f5', 'request_id': 'req-7b217512-1f3a-4973-a748-1f6de7298893'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.273631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac765aa84cf34878aebd49f345bb12f5', 'request_id': 'req-7b217512-1f3a-4973-a748-1f6de7298893'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.281060 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac765aa84cf34878aebd49f345bb12f5', 'request_id': 'req-7b217512-1f3a-4973-a748-1f6de7298893'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.293320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] The token cache is being invalidate because project ac765aa84cf34878aebd49f345bb12f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:19.293604 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.294240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.295694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1363/2680] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:19 2022] DELETE /identity/v3/projects/ac765aa84cf34878aebd49f345bb12f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:19.299685 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:19.301255 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:19.314613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42361d0-5a24-44c3-8552-193f774f6a02 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:19.369227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:19.370398 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:19.370666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:19.370932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] PATH_INFO: `/v3/users/d4e85b0d12864eeea62833647ae75010` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:19.372014 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e85b0d12864eeea62833647ae75010)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:19.373924 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:19.395434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:19.421666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e85b0d12864eeea62833647ae75010'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.429282 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e85b0d12864eeea62833647ae75010'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.430035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e85b0d12864eeea62833647ae75010'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.430681 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e85b0d12864eeea62833647ae75010'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.438536 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b0ca38f5-54b4-4e6e-9386-f37ba3f3a5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e85b0d12864eeea62833647ae75010'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.457288 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1318/2681] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:19 2022] DELETE /identity/v3/users/d4e85b0d12864eeea62833647ae75010 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:19.755448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:19.757485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:19.779471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217512-1f3a-4973-a748-1f6de7298893 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:19.848754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:19.849450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:19.849903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:19.850206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] PATH_INFO: `/v3/projects/da29f56e3ed54310a2f7a1f707c77878` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:19.851292 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da29f56e3ed54310a2f7a1f707c77878)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:19.853350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:19.857119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:19.915803 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da29f56e3ed54310a2f7a1f707c77878', 'request_id': 'req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.923354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da29f56e3ed54310a2f7a1f707c77878', 'request_id': 'req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.931421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da29f56e3ed54310a2f7a1f707c77878', 'request_id': 'req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.944289 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] The token cache is being invalidate because project da29f56e3ed54310a2f7a1f707c77878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:19.944911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.945611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3b4ca54b-ed74-4e6e-9e7c-0922376c5475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:19.947575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1364/2682] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:19 2022] DELETE /identity/v3/projects/da29f56e3ed54310a2f7a1f707c77878 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:19.953249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:19.953526 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:19.953867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:19.977039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:19.978293 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:20.037914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1319/2683] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:20.048347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.048656 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.048928 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.068058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:20.069284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:20.078139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1365/2684] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:20.082365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.093386 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da3b38-7d52-4feb-b036-2af9e77467cb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.097880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.098470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.098746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.099013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.099651 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:20.099948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.101611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.113515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1320/2685] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:20.117933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.127207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3d270-3508-4e7f-8fc5-23a202297e8d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.131854 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.132547 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.132860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.133131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.133743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.136133 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.176726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1366/2686] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:20.180851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.191274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c737-46e1-40d1-9aa4-e868bc114549 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.246242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.246831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.247106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.247373 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.247986 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.249904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.270547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1321/2687] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:20.274598 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.285745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29968cca-a710-4165-9c3e-662be406cb5c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.290562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.291254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.291759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.292100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.292762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.294351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.304297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1367/2688] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:20.308218 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.318792 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64997268-ba2f-4829-96c1-e7a595714320 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.323889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49bac5-cb14-478e-a528-cecc7c65ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.324482 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49bac5-cb14-478e-a528-cecc7c65ca80 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.324790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49bac5-cb14-478e-a528-cecc7c65ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.325062 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49bac5-cb14-478e-a528-cecc7c65ca80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.325692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49bac5-cb14-478e-a528-cecc7c65ca80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.327270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49bac5-cb14-478e-a528-cecc7c65ca80 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.337667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1322/2689] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:20.342569 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.352338 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7799e9-0e52-43d2-8ade-09935f85fe16 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.356861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.357489 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.357764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.358032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] PATH_INFO: `/v3/projects/00fa2a5781eb4e63bb040e65e12e8313/users/602cab054e6e4381911ccbe6e6d54d4a/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.372113 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fa2a5781eb4e63bb040e65e12e8313, user_id=602cab054e6e4381911ccbe6e6d54d4a, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.374735 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.387726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1368/2690] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:20 2022] PUT /identity/v3/projects/00fa2a5781eb4e63bb040e65e12e8313/users/602cab054e6e4381911ccbe6e6d54d4a/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:20.398484 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.398769 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.399039 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.412789 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:20.428773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] MFA Rules not processed for user `602cab054e6e4381911ccbe6e6d54d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:20.429975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:20.491559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1323/2691] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:20.496603 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.560903 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12087129-56d1-4bc2-87e4-7716a1790e7f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.565523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.566117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.566393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.566706 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.567320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.569258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.595079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1369/2692] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:20.599192 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.609767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b32c8-77ef-419f-97a1-4bb8869d7648 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.664812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.665346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.665624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.665894 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.666518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.668454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.689052 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1324/2693] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:20.692889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.704345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e3cc-d0c2-4c00-b76c-ec0d01014ab7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.709041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.709625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.709905 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.710179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.710809 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.712394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.722894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1370/2694] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:20.726898 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.739541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080350-5586-4e72-a6b4-74a4736e53ad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.744893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.745632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.745907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.746186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] PATH_INFO: `/v3/projects/43854c3478be4d54ba3863167a44f65e/users/3b31ad4a9dcc4002a02527e39e150c34/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.764670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43854c3478be4d54ba3863167a44f65e, user_id=3b31ad4a9dcc4002a02527e39e150c34, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.767272 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.782033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1325/2695] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:20 2022] PUT /identity/v3/projects/43854c3478be4d54ba3863167a44f65e/users/3b31ad4a9dcc4002a02527e39e150c34/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:20.786119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.791861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:20.798611 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb557-7af8-4272-86af-a99080f8c389 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.865070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325324be-5b99-45a7-bd9c-067ccc8247bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.865667 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325324be-5b99-45a7-bd9c-067ccc8247bf admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.865947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325324be-5b99-45a7-bd9c-067ccc8247bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.866214 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325324be-5b99-45a7-bd9c-067ccc8247bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.866841 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325324be-5b99-45a7-bd9c-067ccc8247bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.868417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325324be-5b99-45a7-bd9c-067ccc8247bf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.878753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1371/2696] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:20.883415 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:20.894515 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6157-324a-4e6b-af6f-122b9301466c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:20.899557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:20.900227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.900670 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.900928 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] PATH_INFO: `/v3/projects/43854c3478be4d54ba3863167a44f65e/users/3b31ad4a9dcc4002a02527e39e150c34/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.903082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43854c3478be4d54ba3863167a44f65e, user_id=3b31ad4a9dcc4002a02527e39e150c34, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:20.905640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:20.916981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1326/2697] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:20 2022] PUT /identity/v3/projects/43854c3478be4d54ba3863167a44f65e/users/3b31ad4a9dcc4002a02527e39e150c34/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:20.927106 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:20.927398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:20.928412 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:20.958671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] MFA Rules not processed for user `3b31ad4a9dcc4002a02527e39e150c34`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:20.959945 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:21.066160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1372/2698] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:21.078633 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:21.080427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:21.141868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:21.147173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649449ee-3ace-4739-bf54-4482fa1f6872 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:21.151191 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9809d08-1bd9-44b4-b86b-688ab6c774c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:21.151800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9809d08-1bd9-44b4-b86b-688ab6c774c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:21.152097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9809d08-1bd9-44b4-b86b-688ab6c774c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:21.152371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9809d08-1bd9-44b4-b86b-688ab6c774c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:21.163079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9809d08-1bd9-44b4-b86b-688ab6c774c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:21.165346 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9809d08-1bd9-44b4-b86b-688ab6c774c2 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:21.180239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1327/2699] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:21.722007 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:21.784865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4688ea-4d53-42d3-be3c-b935d259d9d6 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:21.789647 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:21.790274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:21.790549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:21.790819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] PATH_INFO: `/v3/users/602cab054e6e4381911ccbe6e6d54d4a` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:21.791938 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602cab054e6e4381911ccbe6e6d54d4a)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:21.793859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:21.823722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:21.842609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602cab054e6e4381911ccbe6e6d54d4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:21.849660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602cab054e6e4381911ccbe6e6d54d4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:21.850336 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602cab054e6e4381911ccbe6e6d54d4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:21.850933 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602cab054e6e4381911ccbe6e6d54d4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:21.857921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602cab054e6e4381911ccbe6e6d54d4a'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:21.875034 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1373/2700] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:21 2022] DELETE /identity/v3/users/602cab054e6e4381911ccbe6e6d54d4a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:21.879489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:21.879975 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:21.880078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:21.899090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:21.900423 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:21.958478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1328/2701] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:21.968922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:21.970310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:22.026718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a335-e8d5-416a-b81a-877b0680e928 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:22.030344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:22.030935 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:22.031211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:22.031485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:22.040627 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:22.042135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:22.051476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1374/2702] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:22.366020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:22.367580 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:22.380873 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadea76-428e-4d61-b02d-8971131f5846 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:22.386705 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:22.387341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:22.387870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:22.387870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] PATH_INFO: `/v3/projects/00fa2a5781eb4e63bb040e65e12e8313` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:22.389519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fa2a5781eb4e63bb040e65e12e8313)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:22.391434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:22.453324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fa2a5781eb4e63bb040e65e12e8313', 'request_id': 'req-d439385f-9229-4f77-8da0-d6f623d19724'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.459182 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fa2a5781eb4e63bb040e65e12e8313', 'request_id': 'req-d439385f-9229-4f77-8da0-d6f623d19724'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.466469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fa2a5781eb4e63bb040e65e12e8313', 'request_id': 'req-d439385f-9229-4f77-8da0-d6f623d19724'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.481164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] The token cache is being invalidate because project 00fa2a5781eb4e63bb040e65e12e8313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:22.481454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.482133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.484914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1329/2703] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:22 2022] DELETE /identity/v3/projects/00fa2a5781eb4e63bb040e65e12e8313 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:22.488510 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:22.500934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc56fa8-f14d-4dbf-9f3e-3ee6b435b597 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:22.572144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:22.572835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:22.573111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:22.573380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] PATH_INFO: `/v3/users/3b31ad4a9dcc4002a02527e39e150c34` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:22.574528 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b31ad4a9dcc4002a02527e39e150c34)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:22.576478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:22.635850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b31ad4a9dcc4002a02527e39e150c34'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.637187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:22.646219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b31ad4a9dcc4002a02527e39e150c34'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.646992 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b31ad4a9dcc4002a02527e39e150c34'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.647782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b31ad4a9dcc4002a02527e39e150c34'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.655225 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-5a3081fa-8242-442c-be60-faa85331b636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b31ad4a9dcc4002a02527e39e150c34'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:22.674229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1375/2704] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:22 2022] DELETE /identity/v3/users/3b31ad4a9dcc4002a02527e39e150c34 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:22.957590 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:22.959997 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:22.974029 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439385f-9229-4f77-8da0-d6f623d19724 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.030796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.031352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.031628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.031897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] PATH_INFO: `/v3/projects/43854c3478be4d54ba3863167a44f65e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.033037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43854c3478be4d54ba3863167a44f65e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.034904 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.051659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:23.081649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43854c3478be4d54ba3863167a44f65e', 'request_id': 'req-55608be6-54b5-4e8b-bffc-7db5ab1af96e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:23.087118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43854c3478be4d54ba3863167a44f65e', 'request_id': 'req-55608be6-54b5-4e8b-bffc-7db5ab1af96e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:23.096020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43854c3478be4d54ba3863167a44f65e', 'request_id': 'req-55608be6-54b5-4e8b-bffc-7db5ab1af96e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:23.106552 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] The token cache is being invalidate because project 43854c3478be4d54ba3863167a44f65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:23.106842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:23.107480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-55608be6-54b5-4e8b-bffc-7db5ab1af96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:23.108982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1330/2705] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:22 2022] DELETE /identity/v3/projects/43854c3478be4d54ba3863167a44f65e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:23.114052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.114532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.114630 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.133865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:23.137850 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:23.201138 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1376/2706] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:23.265283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.265562 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.265836 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.285459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:23.286587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:23.294730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1331/2707] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:23.298982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.308731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78cf6-66a6-4f38-9039-0b69b0549532 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.313167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.313747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.314018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.314282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.314907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:23.315229 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.316824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.328790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1377/2708] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:23.332983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.342867 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51acd-66b5-4842-b4f8-9f977033df75 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.347473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.348061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.348335 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.348620 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.349232 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.351096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.378875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1332/2709] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:23 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:23.383185 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.394427 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c273-1028-40c4-ba32-da42572b5e20 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.454454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.455186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.455532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.455819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.456500 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.458418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.481700 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1378/2710] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:23 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:23.486292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.497026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580cf5-0330-4ad3-bd64-4c72b7565249 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.501839 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.502631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.502935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.503210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.504057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.505599 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.520006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1333/2711] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:23.521450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.532971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0b9c-f48a-4150-8786-532a96a1861f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.537948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c3e4-444f-4450-aecb-c0d1530fb5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.538521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c3e4-444f-4450-aecb-c0d1530fb5be admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.538797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c3e4-444f-4450-aecb-c0d1530fb5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.539069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c3e4-444f-4450-aecb-c0d1530fb5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.539973 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2c3e4-444f-4450-aecb-c0d1530fb5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.541793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2c3e4-444f-4450-aecb-c0d1530fb5be admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.553516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1379/2712] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:23.559471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.571576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261aea0-a828-43c3-a3cc-2afc06761315 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.578957 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.580277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.581943 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.582338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] PATH_INFO: `/v3/projects/b0a442d07b8849939da1a73349b2ad26/users/8f342a7a15724cfdb70c9844c15f312e/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.599813 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a442d07b8849939da1a73349b2ad26, user_id=8f342a7a15724cfdb70c9844c15f312e, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.602560 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.620057 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1334/2713] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:23 2022] PUT /identity/v3/projects/b0a442d07b8849939da1a73349b2ad26/users/8f342a7a15724cfdb70c9844c15f312e/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:23.629872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.630419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.630881 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.682237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] MFA Rules not processed for user `8f342a7a15724cfdb70c9844c15f312e`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:23.684998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:23.707251 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:23.778175 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1380/2714] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:23.794219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.794219 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:23.872751 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a925f-a667-4623-8b02-243ce74a51f6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.877883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.878487 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.878759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.879027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.888542 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.890097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.900258 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1335/2715] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:32.412181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.413659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:32.477574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304496ae-1afb-4692-bd42-69b98d2ebb5c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.482387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.482997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.483269 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.483535 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] PATH_INFO: `/v3/users/c8092aa3721e4258bc59a0ca54eb2b46` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.484638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8092aa3721e4258bc59a0ca54eb2b46)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.486657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.531940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8092aa3721e4258bc59a0ca54eb2b46'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.538669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8092aa3721e4258bc59a0ca54eb2b46'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.539322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8092aa3721e4258bc59a0ca54eb2b46'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.540169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8092aa3721e4258bc59a0ca54eb2b46'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.547579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8092aa3721e4258bc59a0ca54eb2b46'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.564846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1381/2716] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:32 2022] DELETE /identity/v3/users/c8092aa3721e4258bc59a0ca54eb2b46 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:32.737502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.749976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f07429-8aab-4860-b4f7-41b402cc644c service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.797200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:32.818091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.818733 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.819019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.819292 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] PATH_INFO: `/v3/projects/0aa5205b5a024ea98015b2d3fbd19883` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.820448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa5205b5a024ea98015b2d3fbd19883)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.822923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.870243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa5205b5a024ea98015b2d3fbd19883', 'request_id': 'req-a2594f32-2790-4221-b73a-ddef3e2d462e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.875658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa5205b5a024ea98015b2d3fbd19883', 'request_id': 'req-a2594f32-2790-4221-b73a-ddef3e2d462e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.882706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa5205b5a024ea98015b2d3fbd19883', 'request_id': 'req-a2594f32-2790-4221-b73a-ddef3e2d462e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.894249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] The token cache is being invalidate because project 0aa5205b5a024ea98015b2d3fbd19883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:32.894540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.895306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:32.896982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1336/2717] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:32 2022] DELETE /identity/v3/projects/0aa5205b5a024ea98015b2d3fbd19883 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:33.856365 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:33.857828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:33.871164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3fbe-5c29-4e23-9fde-bf04844caecb admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:33.910245 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:33.932574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:33.933215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:33.933523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:33.933762 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] PATH_INFO: `/v3/users/8f342a7a15724cfdb70c9844c15f312e` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:33.934937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f342a7a15724cfdb70c9844c15f312e)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:33.936869 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:33.987456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f342a7a15724cfdb70c9844c15f312e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:33.991142 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:33.993095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:33.999180 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f342a7a15724cfdb70c9844c15f312e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.000169 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f342a7a15724cfdb70c9844c15f312e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.004954 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f342a7a15724cfdb70c9844c15f312e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.006817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594f32-2790-4221-b73a-ddef3e2d462e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.013273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.013769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-885d2b82-b1e1-494e-a271-905f8796b001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f342a7a15724cfdb70c9844c15f312e'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.013918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.014177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.014445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] PATH_INFO: `/v3/users/b47bd29f04b14c9f979f3de756cc899e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.015559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47bd29f04b14c9f979f3de756cc899e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.017491 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.031958 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1382/2718] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:33 2022] DELETE /identity/v3/users/8f342a7a15724cfdb70c9844c15f312e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.036524 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.036911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.037249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.058780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:34.060092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.066287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47bd29f04b14c9f979f3de756cc899e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.074367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47bd29f04b14c9f979f3de756cc899e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.075186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47bd29f04b14c9f979f3de756cc899e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.075825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47bd29f04b14c9f979f3de756cc899e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.083440 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47bd29f04b14c9f979f3de756cc899e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.101444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1337/2719] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:33 2022] DELETE /identity/v3/users/b47bd29f04b14c9f979f3de756cc899e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:34.121839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1383/2720] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:34.131485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.132974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.187852 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:34.193532 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3aa70b-55b4-4c10-8af3-9efb2447bbbd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.199823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.200498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.200802 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.201109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.261609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.263095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.273688 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1338/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:34.286254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.287889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.302516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e152f-807a-4f0b-af21-8cc2a585c96f None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.308031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.308779 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.309181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.309629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] PATH_INFO: `/v3/projects/f55a6953d25a45aca39a4551349ab443` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.311082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55a6953d25a45aca39a4551349ab443)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.313309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.367450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55a6953d25a45aca39a4551349ab443', 'request_id': 'req-1f82b177-cea4-4371-b299-64aaa056dade'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.371696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:34.374483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55a6953d25a45aca39a4551349ab443', 'request_id': 'req-1f82b177-cea4-4371-b299-64aaa056dade'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.384071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55a6953d25a45aca39a4551349ab443', 'request_id': 'req-1f82b177-cea4-4371-b299-64aaa056dade'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.396699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] The token cache is being invalidate because project f55a6953d25a45aca39a4551349ab443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:34.396987 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.397659 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.399875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1384/2722] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/projects/f55a6953d25a45aca39a4551349ab443 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.403846 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.414999 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535553-1829-4956-839a-3c5a35c7c00e service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.480462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.481130 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.481408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.481675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] PATH_INFO: `/v3/users/8be7547e7ee8464e83c8f2b026c31833` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.482797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be7547e7ee8464e83c8f2b026c31833)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.484727 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.536976 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be7547e7ee8464e83c8f2b026c31833'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.546075 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be7547e7ee8464e83c8f2b026c31833'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.546820 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be7547e7ee8464e83c8f2b026c31833'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.547459 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be7547e7ee8464e83c8f2b026c31833'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.555703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-64ac8283-58b5-4add-84d6-6f9880490da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be7547e7ee8464e83c8f2b026c31833'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.575803 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1339/2723] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/users/8be7547e7ee8464e83c8f2b026c31833 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.580263 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.581665 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.594253 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82b177-cea4-4371-b299-64aaa056dade admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.663057 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.663719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.663996 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.664270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] PATH_INFO: `/v3/projects/b0a442d07b8849939da1a73349b2ad26` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.666265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a442d07b8849939da1a73349b2ad26)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.668158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.717490 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a442d07b8849939da1a73349b2ad26', 'request_id': 'req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.723451 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a442d07b8849939da1a73349b2ad26', 'request_id': 'req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.731081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a442d07b8849939da1a73349b2ad26', 'request_id': 'req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.742756 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] The token cache is being invalidate because project b0a442d07b8849939da1a73349b2ad26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:34.743079 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.743734 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.746105 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1385/2724] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/projects/b0a442d07b8849939da1a73349b2ad26 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.751495 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce850e-7358-48e0-befa-9008de50a13a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.751798 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce850e-7358-48e0-befa-9008de50a13a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.752072 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce850e-7358-48e0-befa-9008de50a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.766237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.768173 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.773817 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-30ce850e-7358-48e0-befa-9008de50a13a None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:34.775674 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-30ce850e-7358-48e0-befa-9008de50a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.789056 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:34.841386 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cffaa-5f6a-4e7f-9074-cb3b9276c14b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.846112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.846845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.847221 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.847589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] PATH_INFO: `/v3/projects/9c78c464b644417c871392c893d5529e` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.848508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1340/2725] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:34.856521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c78c464b644417c871392c893d5529e)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.856521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.858059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.858378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.858657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.867975 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:34.879578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:34.880816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.889570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1341/2726] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:34.893985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.903350 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c78c464b644417c871392c893d5529e', 'request_id': 'req-2682a1ab-a776-4f76-9005-1f5fa5f5b016'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.906254 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192409d-d956-4c91-b5b2-17be6d5a97a8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.909702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c78c464b644417c871392c893d5529e', 'request_id': 'req-2682a1ab-a776-4f76-9005-1f5fa5f5b016'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.917766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c78c464b644417c871392c893d5529e', 'request_id': 'req-2682a1ab-a776-4f76-9005-1f5fa5f5b016'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.929362 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] The token cache is being invalidate because project 9c78c464b644417c871392c893d5529e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:34.929649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.930294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-2682a1ab-a776-4f76-9005-1f5fa5f5b016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.932677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1386/2727] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/projects/9c78c464b644417c871392c893d5529e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:34.937318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c58f-950c-40b9-acc5-8227b37480af None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.937600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c58f-950c-40b9-acc5-8227b37480af None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.937871 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c58f-950c-40b9-acc5-8227b37480af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.958346 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-1061c58f-950c-40b9-acc5-8227b37480af None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:34.959561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1061c58f-950c-40b9-acc5-8227b37480af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.966958 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.967591 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.967865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.968303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.969006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:34.969338 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.970926 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.982518 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1342/2728] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:34.986854 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.988494 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.001262 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f9e3-6bad-43fe-824a-89c1d102f514 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.005903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.006471 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.006746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.007017 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.007627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.009593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.019461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1387/2729] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:35.027732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.028020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.028322 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.038490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1343/2730] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:35.042738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.048004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:35.049219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.106729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c707d4-4416-4ac1-bc51-330cabd1597a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.110189 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1388/2731] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:35.112089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.112800 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.113077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.113430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.114045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.114482 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.115954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.124001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c6190-deb4-428c-8d4d-079442c96463 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.130095 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.131066 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.131738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.132065 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.133161 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:35.133730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.137383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.144470 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1344/2732] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:35 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:35.148486 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.156971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1389/2733] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:29:35.158198 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.159794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a4b2-ef77-4a65-a6c5-a0904b381d3a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.164380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.165265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.165572 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.165874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.166922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.167977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab923-83e1-49e4-8397-92eb4cdf6ccc admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.168528 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.172512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.173109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.173382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.173657 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.174280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.174428 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:35.176307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.182623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1345/2734] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:35.183640 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.193240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7d56-e090-449c-89c8-76fabd4adb8a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.198970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.199761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.200036 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.200302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.200963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.202564 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.205450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1390/2735] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:35 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:35.209534 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.216929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1346/2736] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:35.218069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.220031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:35.229498 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164d12-2170-4369-b083-d70bcb97a30d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.277387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febe20-e897-4985-b32b-519c08d5fcd0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.282141 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.282682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.282957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.283226 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.283840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.285795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.285995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444235c-a3e3-44e9-ba7a-44481d74898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.286635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444235c-a3e3-44e9-ba7a-44481d74898d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.286905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444235c-a3e3-44e9-ba7a-44481d74898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.287365 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444235c-a3e3-44e9-ba7a-44481d74898d admin admin] PATH_INFO: `/v3/projects/c3619a63d25b487a8a0866e8f5fe88a4/users/ba55045d1d164aed91798fead37c9817/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.302455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444235c-a3e3-44e9-ba7a-44481d74898d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3619a63d25b487a8a0866e8f5fe88a4, user_id=ba55045d1d164aed91798fead37c9817, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.305105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444235c-a3e3-44e9-ba7a-44481d74898d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.307575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1391/2737] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:35 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:35.311693 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.318543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1347/2738] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:35 2022] PUT /identity/v3/projects/c3619a63d25b487a8a0866e8f5fe88a4/users/ba55045d1d164aed91798fead37c9817/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:35.321435 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a4464-d62d-4e4d-bdca-5e7f88b91d87 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.324087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.324370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.324673 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.343306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:35.344508 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.378402 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.378998 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.379271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.379538 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.380163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.381768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.392217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1392/2739] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:35.396146 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.404370 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1348/2740] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:35.407220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb69a5-0142-4c6d-9939-6d68e5ce0094 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.412012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.412640 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.413132 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.413276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.413804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.414013 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.415643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.416046 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.426755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1393/2741] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:35.430671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.440419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c2356-fdae-46d2-b762-671e3590de7b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.445055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea5d43-1986-4863-a8a6-050c3582c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.445710 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea5d43-1986-4863-a8a6-050c3582c652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.446029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea5d43-1986-4863-a8a6-050c3582c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.446296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea5d43-1986-4863-a8a6-050c3582c652 admin admin] PATH_INFO: `/v3/projects/586eff409d184e0fa7b2ab0d4f033241/users/8efc59f2e0004e7dbe4013bb861856cf/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.461793 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea5d43-1986-4863-a8a6-050c3582c652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586eff409d184e0fa7b2ab0d4f033241, user_id=8efc59f2e0004e7dbe4013bb861856cf, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.465600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea5d43-1986-4863-a8a6-050c3582c652 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.473752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e772-51f3-4754-8ec1-867e8c63b715 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.478652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1394/2742] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:35 2022] PUT /identity/v3/projects/586eff409d184e0fa7b2ab0d4f033241/users/8efc59f2e0004e7dbe4013bb861856cf/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:35.490436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.490729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.491006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.500103 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:35.522383 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] MFA Rules not processed for user `8efc59f2e0004e7dbe4013bb861856cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:35.523594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.526412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95632b19-6167-40ba-b7d0-b345f7e260fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.527018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95632b19-6167-40ba-b7d0-b345f7e260fe service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.527299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95632b19-6167-40ba-b7d0-b345f7e260fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.527575 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95632b19-6167-40ba-b7d0-b345f7e260fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.570459 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:35.589937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1395/2743] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:35.591158 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95632b19-6167-40ba-b7d0-b345f7e260fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.592667 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95632b19-6167-40ba-b7d0-b345f7e260fe service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.601398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.602454 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1349/2744] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:29:35.602771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.663824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14784f-01d1-43cf-b0d9-5a1a7ed2e2fc None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.668093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.668729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.669004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.669506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.679452 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.681023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.690927 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1396/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:29:40.097941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.098479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.098593 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.136492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] MFA Rules not processed for user `ba55045d1d164aed91798fead37c9817`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:40.138256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:40.239026 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1350/2746] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:40.243609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.256330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cf861-a887-4be3-b109-bee6a49ddc61 service glance] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.261858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.262466 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.262738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.263002 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.263633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.265737 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.301181 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1397/2747] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:40.302237 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.314152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92989574-534e-40d6-be84-12a6b2d94de1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.377862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.378578 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.378929 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.379268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.379982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.382245 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.398570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:40.418721 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1351/2748] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:40 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:40.422342 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.435982 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766fa3e-3387-4832-a403-5c49e12c1889 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.442761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.443754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.444307 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.444519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.445592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.447341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.464740 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1398/2749] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:40.468919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.480120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd5dfc-f84e-49e2-ab61-4d8bfe45b00a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.484862 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.485534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.485944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.486224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] PATH_INFO: `/v3/projects/8c50bf3d8f504365a4c7f4ce1168a6a9/users/e8f32d7b5be24762b530b3f65d26b030/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.503605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c50bf3d8f504365a4c7f4ce1168a6a9, user_id=e8f32d7b5be24762b530b3f65d26b030, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.506393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.522510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1352/2750] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:40 2022] PUT /identity/v3/projects/8c50bf3d8f504365a4c7f4ce1168a6a9/users/e8f32d7b5be24762b530b3f65d26b030/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:40.527261 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.538345 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94a587-d1af-47a0-8b73-fe90d43439e2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.612062 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b32f-1687-46c0-847c-1e90e6a74f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.612707 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b32f-1687-46c0-847c-1e90e6a74f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.612983 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b32f-1687-46c0-847c-1e90e6a74f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.613252 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b32f-1687-46c0-847c-1e90e6a74f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.613887 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b32f-1687-46c0-847c-1e90e6a74f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.615478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b32f-1687-46c0-847c-1e90e6a74f44 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.627332 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1399/2751] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:40.631619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.646565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483005-9de8-4dac-96ca-5dd13202027e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.653951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.654381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.654797 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.655106 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] PATH_INFO: `/v3/projects/8c50bf3d8f504365a4c7f4ce1168a6a9/users/e8f32d7b5be24762b530b3f65d26b030/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.657438 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c50bf3d8f504365a4c7f4ce1168a6a9, user_id=e8f32d7b5be24762b530b3f65d26b030, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.660097 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.674973 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1353/2752] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:40 2022] PUT /identity/v3/projects/8c50bf3d8f504365a4c7f4ce1168a6a9/users/e8f32d7b5be24762b530b3f65d26b030/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:46.086782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bed36-058c-4daa-86d8-aa4113280e16 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:46.087239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bed36-058c-4daa-86d8-aa4113280e16 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:46.087544 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bed36-058c-4daa-86d8-aa4113280e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:46.145432 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-b11bed36-058c-4daa-86d8-aa4113280e16 None None] MFA Rules not processed for user `e8f32d7b5be24762b530b3f65d26b030`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:46.146680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-b11bed36-058c-4daa-86d8-aa4113280e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:46.215280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:46.242417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1400/2753] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:46.257429 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:46.259692 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:46.361512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729634-8295-4a01-8b41-da387b73eb7c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:46.368589 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:46.369793 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:46.370234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:46.370506 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:46.435661 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:46.437387 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:46.450669 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1354/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:47.585846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:47.586382 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:47.586518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:47.607552 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] MFA Rules not processed for user `ba55045d1d164aed91798fead37c9817`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:47.608827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:47.616786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1401/2755] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:48.951082 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:48.953259 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:49.033723 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6436-39d2-4e3f-9400-6af734f4686c service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:49.039109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:49.039109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:49.039109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:49.039539 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:49.043265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:49.054796 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:49.116936 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:49.118427 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:49.129178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1355/2756] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:52.539561 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:52.541426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:52.560855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539fa64-cbcb-447d-bcdc-d4b07d5a0409 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:52.565763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:52.566418 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:52.566835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:52.567117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] PATH_INFO: `/v3/users/0b74cad47e9a4dd1b8b931d3934ae70d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:52.568305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b74cad47e9a4dd1b8b931d3934ae70d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:52.570468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:52.642687 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b74cad47e9a4dd1b8b931d3934ae70d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:52.655759 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b74cad47e9a4dd1b8b931d3934ae70d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:52.656508 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b74cad47e9a4dd1b8b931d3934ae70d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:52.658312 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b74cad47e9a4dd1b8b931d3934ae70d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:52.670223 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-3fc7cb0c-deb4-436d-9e8d-9173472cad6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b74cad47e9a4dd1b8b931d3934ae70d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:52.693139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1402/2757] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:52 2022] DELETE /identity/v3/users/0b74cad47e9a4dd1b8b931d3934ae70d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:52.889628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:52.902425 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca26632-8426-4c2a-88c6-dc7ae0ea9d92 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:52.965503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:52.966275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:52.966567 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:52.966841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] PATH_INFO: `/v3/projects/61280635625e4ba680a2da6f71c72e22` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:52.968085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61280635625e4ba680a2da6f71c72e22)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:52.970178 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.016318 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61280635625e4ba680a2da6f71c72e22', 'request_id': 'req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:53.022388 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61280635625e4ba680a2da6f71c72e22', 'request_id': 'req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:53.033239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61280635625e4ba680a2da6f71c72e22', 'request_id': 'req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:53.045636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] The token cache is being invalidate because project 61280635625e4ba680a2da6f71c72e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:53.045831 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:53.046400 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-eef8fd70-4613-42ae-94cd-fdfb3a16fd14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:53.047880 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1356/2758] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:52 2022] DELETE /identity/v3/projects/61280635625e4ba680a2da6f71c72e22 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:53.053052 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.053747 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.054058 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.076090 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:53.077436 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:53.144612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1403/2759] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:53.152613 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.152897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.153170 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.176212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:53.177352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:53.187242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1357/2760] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:53.191594 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.201596 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae007b-31ee-44ee-b944-efa68bdaad0c None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.206316 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.207071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.207360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.207752 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.208520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:53.208864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.210468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.222533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1404/2761] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:53.228653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.238134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292470-f039-4b27-b2b7-ee35de62bc27 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.242790 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.243385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.244239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.244512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.245163 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.247080 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.275367 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1358/2762] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:53.279551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.289580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cac38-5fa1-4130-9b80-9adc76f95df0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.320100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:53.349498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.350096 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.350373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.350642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.351254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.354031 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.378347 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1405/2763] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:53.383448 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.394277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84dde-a787-4d5d-8a2b-b47100afd9c2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.398807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.399402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.399675 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.400472 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.401135 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.402754 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.404859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:53.418698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1359/2764] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:53.419139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.429761 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a20897-e453-4de7-b31f-31e0bdc43fa6 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.434441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef205cf-6a7e-4482-95d2-fd7f1a216eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.435039 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef205cf-6a7e-4482-95d2-fd7f1a216eec admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.435311 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef205cf-6a7e-4482-95d2-fd7f1a216eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.435581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef205cf-6a7e-4482-95d2-fd7f1a216eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.436217 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef205cf-6a7e-4482-95d2-fd7f1a216eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.437829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef205cf-6a7e-4482-95d2-fd7f1a216eec admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.454772 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1406/2765] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:53.458962 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.483140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d1bd7-0373-41b5-872b-fd050261fbff admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.488794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.489460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.489740 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.490015 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] PATH_INFO: `/v3/projects/eaaf9f8507214ed494ba4940f97ce480/users/3005dcdd73ee4c189d2d3965e98207f2/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.513090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaf9f8507214ed494ba4940f97ce480, user_id=3005dcdd73ee4c189d2d3965e98207f2, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.515857 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.529872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1360/2766] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:53 2022] PUT /identity/v3/projects/eaaf9f8507214ed494ba4940f97ce480/users/3005dcdd73ee4c189d2d3965e98207f2/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:53.541085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.541612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.541797 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.572654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] MFA Rules not processed for user `3005dcdd73ee4c189d2d3965e98207f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:53.575071 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:53.659404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1407/2767] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:53.664197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.733074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4d1d-6499-4aa7-b37b-0113f71bc31c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.737955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.738559 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.738832 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.739095 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.739711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.741637 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.769522 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1361/2768] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:53.773692 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.784378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44bbcd-5bcd-40cb-b141-892c8880250d None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.843723 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.844339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.844676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.844950 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.845581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.847539 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.870828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1408/2769] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:53.874848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.886396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b150f9-6e17-4bba-bd3f-5ac91aafa1d7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.891033 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.891648 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.891884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.892164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.892818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.894393 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.905071 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1362/2770] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:53.909378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.921822 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680cdaf-9cde-42b9-b76b-ce8af93e2c10 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.926580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.927240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.927519 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.927792 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] PATH_INFO: `/v3/projects/8754a466486c4fa4a960c3a387e8ee26/users/75e957a8cd0c4ea8bb0dc16f211ba0cb/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.943819 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8754a466486c4fa4a960c3a387e8ee26, user_id=75e957a8cd0c4ea8bb0dc16f211ba0cb, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.946480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.961421 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1409/2771] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:53 2022] PUT /identity/v3/projects/8754a466486c4fa4a960c3a387e8ee26/users/75e957a8cd0c4ea8bb0dc16f211ba0cb/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:53.965807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.975903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299022c6-27ba-4819-af99-0d1d3485bb12 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:54.036804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55623c-b562-4382-9c93-eea583573539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:54.037309 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55623c-b562-4382-9c93-eea583573539 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:54.037585 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55623c-b562-4382-9c93-eea583573539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:54.037884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55623c-b562-4382-9c93-eea583573539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:54.038513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55623c-b562-4382-9c93-eea583573539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:54.040998 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55623c-b562-4382-9c93-eea583573539 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:54.051089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1363/2772] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:54.055395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:54.067644 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa336b68-781d-48d7-800b-728787bfc83e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:54.072610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:54.073278 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:54.073558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:54.073842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] PATH_INFO: `/v3/projects/8754a466486c4fa4a960c3a387e8ee26/users/75e957a8cd0c4ea8bb0dc16f211ba0cb/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:54.075769 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8754a466486c4fa4a960c3a387e8ee26, user_id=75e957a8cd0c4ea8bb0dc16f211ba0cb, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:54.078448 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:54.080832 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:54.090831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1410/2773] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:54 2022] PUT /identity/v3/projects/8754a466486c4fa4a960c3a387e8ee26/users/75e957a8cd0c4ea8bb0dc16f211ba0cb/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:54.102555 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:54.103382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:54.104283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:54.135186 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] MFA Rules not processed for user `75e957a8cd0c4ea8bb0dc16f211ba0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:54.136502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:54.171199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:54.209875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1364/2774] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:29:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:54.222426 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:54.224109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:54.282170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2013b-b3b2-4be0-9f1c-7c56e91796a3 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:54.285911 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:54.286551 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:54.286863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:54.287081 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:54.297768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:54.299208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:54.308786 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1411/2775] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:54.389073 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:54.398732 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6c9e1-3abc-4bd7-a813-3931c7e2480c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:54.405489 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927597a6-7b04-4952-a932-f38819006a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:54.406108 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927597a6-7b04-4952-a932-f38819006a19 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:54.406385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927597a6-7b04-4952-a932-f38819006a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:54.406653 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927597a6-7b04-4952-a932-f38819006a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:54.475050 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927597a6-7b04-4952-a932-f38819006a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:54.476483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927597a6-7b04-4952-a932-f38819006a19 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:54.486101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1365/2776] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:01.617275 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:01.680212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd215c67-67f5-42e3-b7bb-b5a6747081f6 service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:01.684791 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:01.685417 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:01.685695 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:01.685964 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] PATH_INFO: `/v3/users/3005dcdd73ee4c189d2d3965e98207f2` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:01.687070 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3005dcdd73ee4c189d2d3965e98207f2)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:01.688995 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:01.735811 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3005dcdd73ee4c189d2d3965e98207f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:01.743232 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3005dcdd73ee4c189d2d3965e98207f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:01.744149 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3005dcdd73ee4c189d2d3965e98207f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:01.744805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3005dcdd73ee4c189d2d3965e98207f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:01.752440 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3005dcdd73ee4c189d2d3965e98207f2'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:01.769771 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1412/2777] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:01 2022] DELETE /identity/v3/users/3005dcdd73ee4c189d2d3965e98207f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:01.774313 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:01.775360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:01.775646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:01.794808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:01.796021 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:01.854480 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1366/2778] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:01.864143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:01.865607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:01.885215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:01.952164 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179c2c2-eb0c-40a8-b1a5-41db38b566d9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:01.956799 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:01.957678 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:01.958177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:01.958476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:01.970946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:01.972917 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:01.985247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1413/2779] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:30:02.269499 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:02.271079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:02.283294 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f930716-5f1a-4b4c-aef1-ba7b25bb39a8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:02.288621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:02.289278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:02.289473 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:02.289668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] PATH_INFO: `/v3/projects/eaaf9f8507214ed494ba4940f97ce480` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:02.291306 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaf9f8507214ed494ba4940f97ce480)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:02.293265 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:02.341606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaf9f8507214ed494ba4940f97ce480', 'request_id': 'req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.347037 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaf9f8507214ed494ba4940f97ce480', 'request_id': 'req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.350658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:02.354583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaf9f8507214ed494ba4940f97ce480', 'request_id': 'req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.367638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] The token cache is being invalidate because project eaaf9f8507214ed494ba4940f97ce480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:02.367923 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.369271 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.371010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1367/2780] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:02 2022] DELETE /identity/v3/projects/eaaf9f8507214ed494ba4940f97ce480 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:02.375085 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:02.385456 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663de08-1b34-4614-9e71-153c44c164a0 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:02.440829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:02.441446 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:02.441720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:02.441989 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] PATH_INFO: `/v3/users/75e957a8cd0c4ea8bb0dc16f211ba0cb` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:02.443097 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e957a8cd0c4ea8bb0dc16f211ba0cb)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:02.445047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:02.492555 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e957a8cd0c4ea8bb0dc16f211ba0cb'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.499726 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e957a8cd0c4ea8bb0dc16f211ba0cb'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.500384 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e957a8cd0c4ea8bb0dc16f211ba0cb'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.501023 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e957a8cd0c4ea8bb0dc16f211ba0cb'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.509282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c0575c59-54b5-46ae-925a-afa380f600a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e957a8cd0c4ea8bb0dc16f211ba0cb'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.528103 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1414/2781] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:02 2022] DELETE /identity/v3/users/75e957a8cd0c4ea8bb0dc16f211ba0cb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:02.814391 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:02.815816 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:02.831639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98ab3e-95b2-43ba-b43a-f5b7809afcb5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:02.890932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:02.891574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:02.891848 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:02.892118 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] PATH_INFO: `/v3/projects/8754a466486c4fa4a960c3a387e8ee26` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:02.893311 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8754a466486c4fa4a960c3a387e8ee26)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:02.895202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:02.941109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8754a466486c4fa4a960c3a387e8ee26', 'request_id': 'req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.947217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8754a466486c4fa4a960c3a387e8ee26', 'request_id': 'req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.955984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8754a466486c4fa4a960c3a387e8ee26', 'request_id': 'req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.968168 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] The token cache is being invalidate because project 8754a466486c4fa4a960c3a387e8ee26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:02.968466 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.969160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:02.970891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1368/2782] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:02 2022] DELETE /identity/v3/projects/8754a466486c4fa4a960c3a387e8ee26 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:02.975782 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493304f3-000b-4f1a-b131-8b0f56cd2834 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:02.976258 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493304f3-000b-4f1a-b131-8b0f56cd2834 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:02.976373 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493304f3-000b-4f1a-b131-8b0f56cd2834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:02.996802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-493304f3-000b-4f1a-b131-8b0f56cd2834 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:02.998015 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-493304f3-000b-4f1a-b131-8b0f56cd2834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.031351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.061584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1415/2783] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:03.062138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.063547 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.069160 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.069449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.069731 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.077738 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cfd1e-2eb4-4166-bd88-fe278ae04d93 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.082342 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.082963 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.083239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.083511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] PATH_INFO: `/v3/users/8efc59f2e0004e7dbe4013bb861856cf` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.084666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efc59f2e0004e7dbe4013bb861856cf)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.086573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.090859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:03.092120 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.100313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1416/2784] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:03.105100 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.115478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd166e58-6fd1-40e5-abd1-707bab5c0b98 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.121357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.121946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.122239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.122502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.123550 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:30:03.123860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.125526 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.137468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efc59f2e0004e7dbe4013bb861856cf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.137922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1417/2785] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:30:03.142318 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.145639 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efc59f2e0004e7dbe4013bb861856cf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.146410 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efc59f2e0004e7dbe4013bb861856cf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.147031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efc59f2e0004e7dbe4013bb861856cf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.153521 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8855d-672c-4235-854e-30d7d7b7c84a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.154276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-572f2176-ceb4-4443-8841-c617e8b40d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efc59f2e0004e7dbe4013bb861856cf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.158461 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.159053 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.159329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.159607 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.160224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.162147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.164691 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.174574 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1369/2786] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:03 2022] DELETE /identity/v3/users/8efc59f2e0004e7dbe4013bb861856cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:03.178934 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.179397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.179665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.199773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:03.201016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.203513 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1418/2787] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:30:03.207626 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.209238 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.259588 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1370/2788] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:03.269619 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.270951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.273874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e20dfa-9f3a-452c-8334-d61e3ea51d5e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.278566 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.279159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.279431 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.279699 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.280309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.282234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.302536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1419/2789] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:30:03.307158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.316795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a994e6-7fb8-4312-aca2-2e96bb0e0a8b admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.321497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.322110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.322393 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.322666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.323298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.324907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.333211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e1d3-b97e-4b29-bb23-21606121832b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.334910 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1420/2790] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:03.336850 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.337502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.337891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.338143 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.339174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.348152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.348653 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d871-1729-4907-af1c-fc1d451d8655 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.349636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.353957 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eab784-d382-4aa2-9080-1fc17d47e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.354537 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eab784-d382-4aa2-9080-1fc17d47e7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.354815 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eab784-d382-4aa2-9080-1fc17d47e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.355086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eab784-d382-4aa2-9080-1fc17d47e7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.355703 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eab784-d382-4aa2-9080-1fc17d47e7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.357303 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eab784-d382-4aa2-9080-1fc17d47e7bf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.359940 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1371/2791] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:30:03.371842 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1421/2792] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:03.373000 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.382490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497759e7-a7c8-4b64-a4fc-1048233eee0e service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.387174 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.387812 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.388172 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.388444 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] PATH_INFO: `/v3/projects/7ecac5d41c8f47c0aa541f35cf6b2c4c/users/540fbfeba3c24a358a27aa9554bd3012/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.405297 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecac5d41c8f47c0aa541f35cf6b2c4c, user_id=540fbfeba3c24a358a27aa9554bd3012, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.408002 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.421883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1372/2793] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:03 2022] PUT /identity/v3/projects/7ecac5d41c8f47c0aa541f35cf6b2c4c/users/540fbfeba3c24a358a27aa9554bd3012/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:03.434184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.434468 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.434865 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.463077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] MFA Rules not processed for user `540fbfeba3c24a358a27aa9554bd3012`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:03.464313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.514875 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.538527 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1422/2794] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:03.544222 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.607300 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a4a56-1b89-4078-b676-97505719204c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.612189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.612809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.613090 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.613407 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.614028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.615927 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.637200 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.642908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.644400 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.648019 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1373/2795] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:03.648942 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.662940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b0258-6eaf-441e-86ad-bf9394a1bc8b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.718959 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b84e-6e5e-4280-af0d-74273c5c49ac admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.723698 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.724296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.724584 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.724884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.725208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.725503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.725829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.726102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.726371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] PATH_INFO: `/v3/projects/586eff409d184e0fa7b2ab0d4f033241` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.727418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.727635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586eff409d184e0fa7b2ab0d4f033241)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.729919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.750085 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1374/2796] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:03.753971 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.766523 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de966e45-990c-45d8-b916-e2374a7e4089 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.781858 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586eff409d184e0fa7b2ab0d4f033241', 'request_id': 'req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.788717 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586eff409d184e0fa7b2ab0d4f033241', 'request_id': 'req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.802449 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586eff409d184e0fa7b2ab0d4f033241', 'request_id': 'req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.815974 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] The token cache is being invalidate because project 586eff409d184e0fa7b2ab0d4f033241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:03.816172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.816876 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-a7a4a238-d0d5-43a8-b2e9-80227c1deff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:03.818378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1423/2797] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:03 2022] DELETE /identity/v3/projects/586eff409d184e0fa7b2ab0d4f033241 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:03.823296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6099-e60f-4ee3-b11f-85e55e2c05e9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.823582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6099-e60f-4ee3-b11f-85e55e2c05e9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.823852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6099-e60f-4ee3-b11f-85e55e2c05e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.835529 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.836125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.836397 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.836695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.837841 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.839416 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.843280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-deae6099-e60f-4ee3-b11f-85e55e2c05e9 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:03.844498 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-deae6099-e60f-4ee3-b11f-85e55e2c05e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.851974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1375/2798] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:03.853688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1424/2799] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:03.853884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.855364 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.861310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.861593 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.861916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.867490 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43549f94-ec1b-4f25-8d12-314ccb31b5a3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.872419 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.873087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.873359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.873627 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] PATH_INFO: `/v3/projects/ba163d05cf7e418495c49f607983ee11/users/c896429fb9e5488bb993de5d5d1974c6/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.882117 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:03.883357 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:03.887944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba163d05cf7e418495c49f607983ee11, user_id=c896429fb9e5488bb993de5d5d1974c6, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.890671 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.892124 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1425/2800] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:03.896158 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.903935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1376/2801] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:03 2022] PUT /identity/v3/projects/ba163d05cf7e418495c49f607983ee11/users/c896429fb9e5488bb993de5d5d1974c6/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:03.905940 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34a0cf-40e2-4d46-a0aa-9605639d40e8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.907717 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.965044 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.965638 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.965914 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.966208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.966847 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:30:03.967148 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.968227 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6a63-b6e3-4976-bcbe-6d271adf5a1c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:03.968764 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.971131 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.973614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:03.974204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:03.974479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:03.974745 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:03.975381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:03.976982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:03.979210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.988511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1426/2802] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:30:03.989353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:03.993402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1377/2803] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:03.997060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.004219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c380862-496f-410e-8b5b-79fe75db557e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.008111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a178b-b76f-49c1-996b-fb8e3abcd615 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.009387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157593f8-6aa5-40e9-815d-7e4a24504ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.010295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157593f8-6aa5-40e9-815d-7e4a24504ded admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.010666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157593f8-6aa5-40e9-815d-7e4a24504ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.011032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157593f8-6aa5-40e9-815d-7e4a24504ded admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.011654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157593f8-6aa5-40e9-815d-7e4a24504ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.013556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157593f8-6aa5-40e9-815d-7e4a24504ded admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.014656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.015304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.015587 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.015868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] PATH_INFO: `/v3/projects/ba163d05cf7e418495c49f607983ee11/users/c896429fb9e5488bb993de5d5d1974c6/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.017770 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba163d05cf7e418495c49f607983ee11, user_id=c896429fb9e5488bb993de5d5d1974c6, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.020436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.042161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1378/2804] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:03 2022] PUT /identity/v3/projects/ba163d05cf7e418495c49f607983ee11/users/c896429fb9e5488bb993de5d5d1974c6/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:04.045143 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1427/2805] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:03 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:04.049683 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.051965 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.052284 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.052591 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.082727 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] MFA Rules not processed for user `c896429fb9e5488bb993de5d5d1974c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:04.083980 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:04.113855 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d0499-0f93-42f2-8132-d26358c39a54 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.152742 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1428/2806] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:04.163329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.164718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:04.173933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.174537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.174811 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.175446 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.175706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.177649 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.199835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1379/2807] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:04 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:04.203944 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.214070 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21384c39-a494-4581-864f-907c2326ac83 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.218746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.219327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.219606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.219878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.220510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.222120 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.225837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06218e09-36ae-4833-a8a8-f92709851be8 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.229698 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.230295 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.230570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.230857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.231851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1380/2808] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:04.232651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:04.235704 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.246296 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19cde-fafa-419e-8da1-2cdfad15d742 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.250992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.251557 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.251834 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.252109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.252759 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.254352 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.265718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1381/2809] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:04.272392 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.282341 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1316d7-eab5-483e-8aec-ff6d3bddd804 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.287326 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.287970 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.288226 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.288493 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] PATH_INFO: `/v3/projects/e1bd2f7b6f134eb49fa5956ab2aeea08/users/0fe14298cbca4de399273f61ce947f1c/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.293471 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.295032 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cb1d5-ea8b-48b9-9e30-76fb2c0c7972 service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.303215 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bd2f7b6f134eb49fa5956ab2aeea08, user_id=0fe14298cbca4de399273f61ce947f1c, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.304705 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1429/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:30:04.306605 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.320871 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1382/2811] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:04 2022] PUT /identity/v3/projects/e1bd2f7b6f134eb49fa5956ab2aeea08/users/0fe14298cbca4de399273f61ce947f1c/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:04.331860 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.332147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.332422 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.358339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:04.361356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] MFA Rules not processed for user `0fe14298cbca4de399273f61ce947f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:04.363378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:04.430416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1430/2812] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:04.442035 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.477450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:04.500138 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c53fe-f22c-44ef-9d9b-30ff2b9fa77d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.503879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.504504 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.504799 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.505077 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.515141 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:04.516601 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:04.526583 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1383/2813] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:07.317036 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:07.318696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:07.334754 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026225a8-82bd-4360-b085-e0bf9c47b2b9 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:07.339088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:07.339831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:07.340219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:07.340619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:07.342820 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:07.429370 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:07.431094 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:07.443389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1431/2814] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:08.638197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:08.650804 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bdd56-cd3a-4bc8-98f8-a293bf68604c service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:08.655405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:08.656171 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:08.656509 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:08.656893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:08.739025 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:08.740989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:08.751079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1384/2815] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:10.460795 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:10.462140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:10.562846 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ab37-e2c5-4180-b995-6c0d7429111d service cinder] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:10.569512 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:10.573029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:10.573313 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:10.573592 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:10.575621 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:10.597047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:10.599067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea8b9e-5b63-4d17-968e-c761eeea80ca service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:10.612516 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1432/2816] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:13.824287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:13.918977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6c399-8116-44be-9474-4d1e1857e2f8 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:13.924005 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:13.924383 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:13.924609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:13.924933 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] PATH_INFO: `/v3/users/540fbfeba3c24a358a27aa9554bd3012` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:13.926225 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540fbfeba3c24a358a27aa9554bd3012)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:13.928409 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:13.988157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540fbfeba3c24a358a27aa9554bd3012'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:13.996436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540fbfeba3c24a358a27aa9554bd3012'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:13.997359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540fbfeba3c24a358a27aa9554bd3012'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:13.997979 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540fbfeba3c24a358a27aa9554bd3012'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.005016 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540fbfeba3c24a358a27aa9554bd3012'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.012034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:14.024541 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1385/2817] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:13 2022] DELETE /identity/v3/users/540fbfeba3c24a358a27aa9554bd3012 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:14.029067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.029525 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.029634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.048720 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:14.049944 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:14.076971 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=100 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:14.115923 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1433/2818] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:14.123199 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:14.124891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:14.203074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a01b-3a99-4328-a5c8-7333820b5031 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:14.208015 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:14.208264 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.208772 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.209233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.236875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:14.248503 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:14.259283 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1386/2819] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:14.739874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:14.741409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:14.753746 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84e6-f70e-41aa-b3d0-221e91fa3695 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:14.759879 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:14.760529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.760852 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.761109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] PATH_INFO: `/v3/projects/7ecac5d41c8f47c0aa541f35cf6b2c4c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.763144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecac5d41c8f47c0aa541f35cf6b2c4c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:14.765086 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:14.816605 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecac5d41c8f47c0aa541f35cf6b2c4c', 'request_id': 'req-4571dbca-46ce-4445-b79c-0d906ef59b58'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.822112 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecac5d41c8f47c0aa541f35cf6b2c4c', 'request_id': 'req-4571dbca-46ce-4445-b79c-0d906ef59b58'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.830396 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecac5d41c8f47c0aa541f35cf6b2c4c', 'request_id': 'req-4571dbca-46ce-4445-b79c-0d906ef59b58'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.842631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] The token cache is being invalidate because project 7ecac5d41c8f47c0aa541f35cf6b2c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:14.842919 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.843565 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.845183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1434/2820] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:14 2022] DELETE /identity/v3/projects/7ecac5d41c8f47c0aa541f35cf6b2c4c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:14.849211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:14.861286 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f3c2-bc53-427e-b490-e4050547cb86 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:14.921323 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:14.921870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.922140 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.922404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] PATH_INFO: `/v3/users/c896429fb9e5488bb993de5d5d1974c6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.923497 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c896429fb9e5488bb993de5d5d1974c6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:14.925460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:14.973133 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c896429fb9e5488bb993de5d5d1974c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.981045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c896429fb9e5488bb993de5d5d1974c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.981951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c896429fb9e5488bb993de5d5d1974c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.982631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c896429fb9e5488bb993de5d5d1974c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:14.989729 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8b780fb8-f287-4bab-aad5-4f57a5af9a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c896429fb9e5488bb993de5d5d1974c6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.007479 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1387/2821] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:14 2022] DELETE /identity/v3/users/c896429fb9e5488bb993de5d5d1974c6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:15.021022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.022497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.037694 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571dbca-46ce-4445-b79c-0d906ef59b58 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.110063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.110830 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.111184 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.111520 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] PATH_INFO: `/v3/users/0fe14298cbca4de399273f61ce947f1c` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.112802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe14298cbca4de399273f61ce947f1c)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.114796 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.169285 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe14298cbca4de399273f61ce947f1c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.180159 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe14298cbca4de399273f61ce947f1c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.180951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe14298cbca4de399273f61ce947f1c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.181574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe14298cbca4de399273f61ce947f1c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.184337 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:15.192247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe14298cbca4de399273f61ce947f1c'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.217635 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1435/2822] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:15 2022] DELETE /identity/v3/users/0fe14298cbca4de399273f61ce947f1c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:15.222031 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.222647 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.222919 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.245217 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:15.246872 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.253134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:15.335870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1388/2823] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:15.347351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.348941 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.349072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.351153 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.372786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc050cb-bf6a-4c64-aa8a-24c3be7beee7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.377814 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.378658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.378939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.379211 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] PATH_INFO: `/v3/projects/ba163d05cf7e418495c49f607983ee11` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.381788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba163d05cf7e418495c49f607983ee11)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.384113 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.422218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ec36f-67e3-41f4-8b84-55ef27d31027 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.426296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a23a9-f2f2-44ed-b002-9b613d69eb2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.426924 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a23a9-f2f2-44ed-b002-9b613d69eb2e service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.427206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a23a9-f2f2-44ed-b002-9b613d69eb2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.427480 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a23a9-f2f2-44ed-b002-9b613d69eb2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.439977 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a23a9-f2f2-44ed-b002-9b613d69eb2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.441091 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba163d05cf7e418495c49f607983ee11', 'request_id': 'req-49798dae-434b-493e-8ae6-c88f9ef4bbc5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.441701 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a23a9-f2f2-44ed-b002-9b613d69eb2e service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.447093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba163d05cf7e418495c49f607983ee11', 'request_id': 'req-49798dae-434b-493e-8ae6-c88f9ef4bbc5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.453908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1436/2824] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:15.456650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba163d05cf7e418495c49f607983ee11', 'request_id': 'req-49798dae-434b-493e-8ae6-c88f9ef4bbc5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.470188 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] The token cache is being invalidate because project ba163d05cf7e418495c49f607983ee11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:15.470481 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.471155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-49798dae-434b-493e-8ae6-c88f9ef4bbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.472761 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1389/2825] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:15 2022] DELETE /identity/v3/projects/ba163d05cf7e418495c49f607983ee11 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:15.478652 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.478934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.479203 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.500613 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:15.501831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.577314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1437/2826] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:15.585755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.586040 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.586321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.611531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:15.613063 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.623117 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1390/2827] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:15.627650 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.638369 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9663aa-def1-4607-8095-1d0f28a1bfde None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.643006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.643609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.643882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.644147 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.644827 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:30:15.645128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.647014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.663326 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1438/2828] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:30:15.664646 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.676485 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482398c1-bd99-4083-9b88-c882eea740c5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.682233 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.682967 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.683488 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.684332 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.684628 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.686594 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.718421 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1391/2829] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:15 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:15.722601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.735688 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00b1f-b04c-45a3-86e9-148dc7abd52e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.760750 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.763337 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.839000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.840367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.840843 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.841122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.841751 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.843777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.855825 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:15.869180 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7113e-b517-47a4-9905-b8cc95681ad5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.874836 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1439/2830] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:15 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:30:15.876851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.887333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8560c-f003-41b6-945d-3de9f633ff62 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.889519 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.892046 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.892330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.892680 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.892819 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] PATH_INFO: `/v3/projects/e1bd2f7b6f134eb49fa5956ab2aeea08` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.893363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.893851 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.894247 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.894501 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bd2f7b6f134eb49fa5956ab2aeea08)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.894959 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.896492 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.896649 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.908384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:15.910204 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1440/2831] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:15.914248 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.925352 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145720-413a-4e05-8683-825d7d922189 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.930171 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.930777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.931122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.931454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.932157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.934531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.945636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1441/2832] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:15.950102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.954573 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bd2f7b6f134eb49fa5956ab2aeea08', 'request_id': 'req-bc54fa76-6a25-4aeb-acbd-35c6198fb416'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.961198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bd2f7b6f134eb49fa5956ab2aeea08', 'request_id': 'req-bc54fa76-6a25-4aeb-acbd-35c6198fb416'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.962755 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac2263-8e80-4270-b3e1-22e145400aa0 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.970384 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bd2f7b6f134eb49fa5956ab2aeea08', 'request_id': 'req-bc54fa76-6a25-4aeb-acbd-35c6198fb416'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.983985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] The token cache is being invalidate because project e1bd2f7b6f134eb49fa5956ab2aeea08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:15.984270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.985256 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bc54fa76-6a25-4aeb-acbd-35c6198fb416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:15.991363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1392/2833] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:15 2022] DELETE /identity/v3/projects/e1bd2f7b6f134eb49fa5956ab2aeea08 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:16.045618 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:16.046430 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:16.046719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:16.047029 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] PATH_INFO: `/v3/projects/f802749305c24ba28c690af5c62f97d3/users/c9851f739d094c1ca45cb4e018d24394/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:16.066946 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f802749305c24ba28c690af5c62f97d3, user_id=c9851f739d094c1ca45cb4e018d24394, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:16.069868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:16.086580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1442/2834] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:15 2022] PUT /identity/v3/projects/f802749305c24ba28c690af5c62f97d3/users/c9851f739d094c1ca45cb4e018d24394/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:16.100623 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:16.101531 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:16.101865 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:16.134464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] MFA Rules not processed for user `c9851f739d094c1ca45cb4e018d24394`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:16.135734 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:16.215274 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1393/2835] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:16.226684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:16.228401 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:16.286690 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204855df-7da6-4923-bbcd-b880180e1b2e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:16.290999 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:16.291597 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:16.291874 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:16.292139 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:16.301163 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:16.302577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:16.311829 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1443/2836] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:19.287205 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:19.288807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:19.345868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05445a1-b823-46fb-8f51-52ace1f0ec0c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:19.349401 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:19.350001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:19.350278 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:19.350548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:19.352270 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:19.392198 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:19.414915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:19.416621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:19.426718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1394/2837] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:21.196231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:21.205768 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631dc8-d3eb-46b7-9d56-1fe381b9b075 service glance] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:21.209367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:21.209963 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:21.210237 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:21.210504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:21.212234 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:21.222947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:21.224359 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766b5a5-0f59-4bf4-93a4-6fef732a91ed service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:21.233183 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1444/2838] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:29.422268 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=11 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:31.228813 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:INSERT=2,keystone:SELECT=78 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:35.002768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:35.004167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:35.068825 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048be93-493b-44e0-98e0-5fb72960c447 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:35.073380 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:35.074001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.074273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.074540 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] PATH_INFO: `/v3/users/c9851f739d094c1ca45cb4e018d24394` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.076239 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9851f739d094c1ca45cb4e018d24394)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:35.078173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:35.125948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9851f739d094c1ca45cb4e018d24394'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.133189 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9851f739d094c1ca45cb4e018d24394'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.133824 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9851f739d094c1ca45cb4e018d24394'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.134430 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9851f739d094c1ca45cb4e018d24394'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.142266 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9851f739d094c1ca45cb4e018d24394'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.159181 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1395/2839] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:35 2022] DELETE /identity/v3/users/c9851f739d094c1ca45cb4e018d24394 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:35.163719 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.164210 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.164354 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.183197 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:35.185003 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:35.242696 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1445/2840] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:35.253521 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:35.254925 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:35.314010 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113d39e-cae5-4edc-a67b-0f1612452f6d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:35.317725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c83b-f52c-447e-808b-382dff623b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:35.318324 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c83b-f52c-447e-808b-382dff623b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.318621 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c83b-f52c-447e-808b-382dff623b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.318875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c83b-f52c-447e-808b-382dff623b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.328325 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352c83b-f52c-447e-808b-382dff623b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:35.329788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352c83b-f52c-447e-808b-382dff623b65 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:35.339150 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1396/2841] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:35.609296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:35.610704 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:35.625119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c635780-0f0d-4943-a810-52b22b1c99aa None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:35.629716 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:35.630398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.630669 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.630937 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] PATH_INFO: `/v3/projects/f802749305c24ba28c690af5c62f97d3` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.632088 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f802749305c24ba28c690af5c62f97d3)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:35.634020 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:35.680951 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f802749305c24ba28c690af5c62f97d3', 'request_id': 'req-388ba41e-cd9f-421d-909f-c68d6895a749'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.687259 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f802749305c24ba28c690af5c62f97d3', 'request_id': 'req-388ba41e-cd9f-421d-909f-c68d6895a749'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.694135 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f802749305c24ba28c690af5c62f97d3', 'request_id': 'req-388ba41e-cd9f-421d-909f-c68d6895a749'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.705570 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] The token cache is being invalidate because project f802749305c24ba28c690af5c62f97d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80166) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:35.705855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.706493 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-388ba41e-cd9f-421d-909f-c68d6895a749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:35.707953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1446/2842] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:35 2022] DELETE /identity/v3/projects/f802749305c24ba28c690af5c62f97d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:35.713022 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.713304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.713570 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.733874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:35.735061 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:35.752024 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:35.795064 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1397/2843] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:35.802777 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.803063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.803344 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.824610 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:35.825840 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:35.833783 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1447/2844] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:35.837981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:35.848214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d052511-1762-4ba0-bb74-69bc56b26fc7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:35.852760 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:35.853343 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.853614 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.853879 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.854507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:30:35.854827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:35.857197 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:35.868204 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1398/2845] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:30:35.872395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:35.881585 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b1c6-e55c-4187-b5b9-2cb2526920a0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:35.886157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:35.886739 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.887018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.887590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.888240 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:35.890150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:35.921729 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1448/2846] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:35 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:35.922856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:35.932718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f2c5-803b-4282-9bac-4970641afa62 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:35.986774 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:35.987359 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:35.987632 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:35.987900 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:35.988507 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:35.990417 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.011878 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1399/2847] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:35 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:30:36.016595 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.027532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2082bf-4748-42cd-a352-c605a9b7ffa9 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.033022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.033616 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.033888 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.034157 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.034787 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.036363 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.047633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1449/2848] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:36.051565 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.061510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d72851-e4b0-477f-8b1d-a72fe67a1be1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.066020 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d17f0-3b06-4dc5-88ac-b48acc65e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.066603 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d17f0-3b06-4dc5-88ac-b48acc65e68c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.066883 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d17f0-3b06-4dc5-88ac-b48acc65e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.067152 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d17f0-3b06-4dc5-88ac-b48acc65e68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.067778 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d17f0-3b06-4dc5-88ac-b48acc65e68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.069418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d17f0-3b06-4dc5-88ac-b48acc65e68c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.080134 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1400/2849] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:36.084208 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.094712 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca090f-d8a8-4bf7-8eab-9403fee02ddd admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.099309 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.099947 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.100231 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.100504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] PATH_INFO: `/v3/projects/68643811a9ee4836ad3306b18980c892/users/0a4a6a9c18754fb68436d104ec48419d/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.115380 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=68643811a9ee4836ad3306b18980c892, user_id=0a4a6a9c18754fb68436d104ec48419d, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.118064 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.132274 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1450/2850] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:36 2022] PUT /identity/v3/projects/68643811a9ee4836ad3306b18980c892/users/0a4a6a9c18754fb68436d104ec48419d/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:36.143725 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.144008 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.144276 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.174610 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] MFA Rules not processed for user `0a4a6a9c18754fb68436d104ec48419d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:36.175849 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:36.241202 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1401/2851] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:36.245564 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.267001 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:36.309319 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76234-9188-4b7c-8f95-e856903713bf admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.313894 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.314483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.314753 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.315017 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] PATH_INFO: `/v3/projects` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.315633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.317575 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.345099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1451/2852] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:36 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:36.349160 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.360161 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3f09d-a90b-4d83-8b4f-c299051f6424 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.372244 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:36.417457 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.418053 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.418334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.418695 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.419334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.421275 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.441636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1402/2853] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:36 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:36.445880 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.457770 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5384-7fe7-4a23-9f64-cbc4d2a8f26e admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.462282 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.462866 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.463137 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.463405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.464025 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.466364 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.476629 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1452/2854] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:36.480888 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.490977 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd342007-3a1c-462e-a39c-0cedbd057839 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.495581 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.496166 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.496445 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.496823 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] PATH_INFO: `/v3/projects/2b42f512c1ef40edb78f367ee1777e6e/users/63110efdf0234a0bae1c421ad2001a35/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.511710 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b42f512c1ef40edb78f367ee1777e6e, user_id=63110efdf0234a0bae1c421ad2001a35, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.515001 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.527167 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1403/2855] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:36 2022] PUT /identity/v3/projects/2b42f512c1ef40edb78f367ee1777e6e/users/63110efdf0234a0bae1c421ad2001a35/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:36.531118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.541371 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183f9fb-09c2-4680-b9f5-5b8542090dbf admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.597531 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff0acf-019c-421c-8319-ccc5f6f5ad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.598119 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff0acf-019c-421c-8319-ccc5f6f5ad91 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.598404 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff0acf-019c-421c-8319-ccc5f6f5ad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.598645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff0acf-019c-421c-8319-ccc5f6f5ad91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.599264 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff0acf-019c-421c-8319-ccc5f6f5ad91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.600908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff0acf-019c-421c-8319-ccc5f6f5ad91 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.611130 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1453/2856] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:36.615242 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.626059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98eec2-7684-4d4b-8686-dcc0fd960eff admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.630718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.631360 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.631665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.631939 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] PATH_INFO: `/v3/projects/2b42f512c1ef40edb78f367ee1777e6e/users/63110efdf0234a0bae1c421ad2001a35/roles/866f8af7cc5d4f7e994315a5051b1c0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.633874 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b42f512c1ef40edb78f367ee1777e6e, user_id=63110efdf0234a0bae1c421ad2001a35, role_id=866f8af7cc5d4f7e994315a5051b1c0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.636512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.647502 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1404/2857] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:36 2022] PUT /identity/v3/projects/2b42f512c1ef40edb78f367ee1777e6e/users/63110efdf0234a0bae1c421ad2001a35/roles/866f8af7cc5d4f7e994315a5051b1c0c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:36.658387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.658675 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.658953 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.688589 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] MFA Rules not processed for user `63110efdf0234a0bae1c421ad2001a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:36.689839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:36.757936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1454/2858] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:36.770125 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:36.771851 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:36.830930 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1be8ab-4e8e-4565-80ac-88ba2fecd53a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:36.834609 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34aaa6-7e72-4897-8daa-167bc56d0277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:36.835206 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34aaa6-7e72-4897-8daa-167bc56d0277 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:36.835483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34aaa6-7e72-4897-8daa-167bc56d0277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:36.835753 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34aaa6-7e72-4897-8daa-167bc56d0277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:36.891983 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34aaa6-7e72-4897-8daa-167bc56d0277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:36.893458 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34aaa6-7e72-4897-8daa-167bc56d0277 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:36.902128 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1405/2859] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:39.436853 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:39.454167 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:39.500022 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496dca-b8ba-45d8-ba1b-6afb9ef1ff9e None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:39.504532 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:39.505177 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:39.505458 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:39.505732 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] PATH_INFO: `/v3/users/0a4a6a9c18754fb68436d104ec48419d` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:39.506838 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4a6a9c18754fb68436d104ec48419d)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:39.508961 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:39.554859 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4a6a9c18754fb68436d104ec48419d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:39.561654 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4a6a9c18754fb68436d104ec48419d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:39.562293 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4a6a9c18754fb68436d104ec48419d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:39.562878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4a6a9c18754fb68436d104ec48419d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:39.569900 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4a6a9c18754fb68436d104ec48419d'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:39.586765 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1455/2860] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:39 2022] DELETE /identity/v3/users/0a4a6a9c18754fb68436d104ec48419d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:30:39.591948 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:39.592443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:39.592443 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:39.611436 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:39.612665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:39.631982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:39.674214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1406/2861] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:39.683794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:39.685270 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:39.742831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4110bb-0063-4282-9e09-48f2be06f2d8 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:39.746556 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:39.747122 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:39.747397 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:39.747674 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:39.757190 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:39.758612 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:39.768024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1456/2862] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:30:40.050905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:40.052321 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:40.064115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9fb48-010a-4324-a914-6ae8aa53c54b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:40.070763 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:40.071379 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.071650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.071918 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] PATH_INFO: `/v3/projects/68643811a9ee4836ad3306b18980c892` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.073157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=68643811a9ee4836ad3306b18980c892)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:40.075048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:40.124788 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68643811a9ee4836ad3306b18980c892', 'request_id': 'req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.133451 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68643811a9ee4836ad3306b18980c892', 'request_id': 'req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.141907 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68643811a9ee4836ad3306b18980c892', 'request_id': 'req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.152954 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] The token cache is being invalidate because project 68643811a9ee4836ad3306b18980c892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:40.153234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.154468 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.156109 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1407/2863] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:40 2022] DELETE /identity/v3/projects/68643811a9ee4836ad3306b18980c892 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:40.160142 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:40.170506 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583a5b9-53da-4839-b2d6-84b45a467b81 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:40.204990 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:40.229932 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:40.230600 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.230902 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.231170 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] PATH_INFO: `/v3/users/63110efdf0234a0bae1c421ad2001a35` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.232328 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63110efdf0234a0bae1c421ad2001a35)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:40.234666 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:40.280855 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63110efdf0234a0bae1c421ad2001a35'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.287580 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63110efdf0234a0bae1c421ad2001a35'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.288239 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63110efdf0234a0bae1c421ad2001a35'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.288849 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63110efdf0234a0bae1c421ad2001a35'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.296220 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-859efe6a-d769-47f4-afb6-d6ff62a95830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63110efdf0234a0bae1c421ad2001a35'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.313462 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1457/2864] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:40 2022] DELETE /identity/v3/users/63110efdf0234a0bae1c421ad2001a35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:40.605947 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:40.607478 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:40.620390 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e1fe-5bef-41c0-a0cc-93317685f4ce admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:40.677922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:40.678543 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.678818 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.679087 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] PATH_INFO: `/v3/projects/2b42f512c1ef40edb78f367ee1777e6e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.680175 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b42f512c1ef40edb78f367ee1777e6e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:40.682086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:40.734786 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b42f512c1ef40edb78f367ee1777e6e', 'request_id': 'req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.735889 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:40.741757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b42f512c1ef40edb78f367ee1777e6e', 'request_id': 'req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.750330 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b42f512c1ef40edb78f367ee1777e6e', 'request_id': 'req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.761378 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] The token cache is being invalidate because project 2b42f512c1ef40edb78f367ee1777e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:40.761665 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.762328 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dcaf460e-8d2f-4d72-a4e8-27977b26a2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:40.763807 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1408/2865] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:40 2022] DELETE /identity/v3/projects/2b42f512c1ef40edb78f367ee1777e6e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:40.768806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.769305 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.769416 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.788207 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:40.789442 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:40.849985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1458/2866] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:40.857631 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.857914 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.858183 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.878372 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:40.879569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:40.887408 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1409/2867] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:40.892018 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:40.901693 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255978-8c5c-48c9-96a1-a3f9933bef56 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:40.907310 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:40.907896 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.908172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.908441 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.909111 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:30:40.909407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:40.910985 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:40.923415 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1459/2868] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:30:40.927838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:40.938450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4ccc-add8-49ae-9fb2-743e8a5d59ba None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:40.943412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:40.944011 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:40.944284 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:40.944550 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:40.945212 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:40.947177 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:40.973381 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1410/2869] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:40 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:40.977511 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:40.988257 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb724-7b13-4be9-b86c-07c3ec1b6c25 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:41.031340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:41.049802 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:41.050584 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.050862 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.051128 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.051744 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:41.053743 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:41.074041 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1460/2870] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:40 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:41.078124 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:41.088291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488538b8-caa8-4d4d-b028-caf72f27405c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:41.093510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:41.094105 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.094382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.094656 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.095291 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:41.096984 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:41.107964 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1411/2871] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:41.111824 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:41.121663 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5349a5e-41cf-40d3-9d03-3cbdbcf97a2c admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:41.126340 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c45535-3ae4-4ded-bd54-463338fedd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:41.126916 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45535-3ae4-4ded-bd54-463338fedd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.127187 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45535-3ae4-4ded-bd54-463338fedd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.127450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45535-3ae4-4ded-bd54-463338fedd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.128072 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c45535-3ae4-4ded-bd54-463338fedd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:41.129778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c45535-3ae4-4ded-bd54-463338fedd0a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:41.142395 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1461/2872] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:41.146611 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:41.157714 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896c923-f459-4f2c-a066-8467b4c89efe admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:41.162253 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:41.162884 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.163157 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.163426 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] PATH_INFO: `/v3/projects/a048d1512e9746b19f51f44af66c5634/users/de07571a68984e358906715784d8e128/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.179060 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a048d1512e9746b19f51f44af66c5634, user_id=de07571a68984e358906715784d8e128, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:41.181893 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:41.195758 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1412/2873] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:41 2022] PUT /identity/v3/projects/a048d1512e9746b19f51f44af66c5634/users/de07571a68984e358906715784d8e128/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:41.261294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.261518 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.261741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.288839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] MFA Rules not processed for user `de07571a68984e358906715784d8e128`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:41.290035 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:41.351969 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1462/2874] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:41.364101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:41.365815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:41.422966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d24c28-8f55-49ea-9bfb-796f431f6c92 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:41.426566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5dd10-fa19-47a8-9dbf-f78570c3d793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:41.427164 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5dd10-fa19-47a8-9dbf-f78570c3d793 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.427441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5dd10-fa19-47a8-9dbf-f78570c3d793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.427711 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5dd10-fa19-47a8-9dbf-f78570c3d793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.436079 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5dd10-fa19-47a8-9dbf-f78570c3d793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:41.437538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5dd10-fa19-47a8-9dbf-f78570c3d793 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:41.446093 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1413/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:51.349067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:51.442223 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:53.976092 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.038351 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea1dd6-8856-4255-9f77-b8ce689e1378 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.043093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.043718 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.044631 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.044997 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] PATH_INFO: `/v3/users/de07571a68984e358906715784d8e128` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.046178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=de07571a68984e358906715784d8e128)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:54.048118 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:54.092930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de07571a68984e358906715784d8e128'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.099682 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de07571a68984e358906715784d8e128'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.100339 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de07571a68984e358906715784d8e128'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.100972 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de07571a68984e358906715784d8e128'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.109030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de07571a68984e358906715784d8e128'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.126129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1463/2876] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:30:53 2022] DELETE /identity/v3/users/de07571a68984e358906715784d8e128 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:54.130624 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.131112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.131234 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.151034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:54.152243 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:54.210752 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1414/2877] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:54.221077 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.222483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:54.279165 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd45d3-3f61-4a9b-8cd0-71b00970dbeb admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.282775 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed328e98-5fc3-40c5-bf88-a535eca5f4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.283377 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed328e98-5fc3-40c5-bf88-a535eca5f4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.283651 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed328e98-5fc3-40c5-bf88-a535eca5f4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.283922 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed328e98-5fc3-40c5-bf88-a535eca5f4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.293102 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed328e98-5fc3-40c5-bf88-a535eca5f4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:54.294578 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed328e98-5fc3-40c5-bf88-a535eca5f4f3 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:54.304099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1464/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:54.567184 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.568666 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:54.581822 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dff960-c32e-47ff-bec0-1371a46ea66e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.586402 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.587034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.587308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.587577 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] PATH_INFO: `/v3/projects/a048d1512e9746b19f51f44af66c5634` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.588730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a048d1512e9746b19f51f44af66c5634)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:54.590612 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:54.640730 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a048d1512e9746b19f51f44af66c5634', 'request_id': 'req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.646034 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a048d1512e9746b19f51f44af66c5634', 'request_id': 'req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.654045 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a048d1512e9746b19f51f44af66c5634', 'request_id': 'req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.665371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] The token cache is being invalidate because project a048d1512e9746b19f51f44af66c5634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:30:54.665659 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.666404 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f1d25a7b-0b5e-40a0-8da5-0db8faec8c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:30:54.667887 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1415/2879] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:30:54 2022] DELETE /identity/v3/projects/a048d1512e9746b19f51f44af66c5634 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:54.673012 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.673297 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.673571 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.693549 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:54.694741 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:54.712389 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:54.756857 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1465/2880] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:54.765287 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.765566 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.765835 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.784856 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:54.786048 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:54.794569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1416/2881] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:54.798878 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.808845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e75e9c-0dfd-4337-95eb-3ad0358aa94b None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.814450 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.815047 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.815341 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.815636 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.816271 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:30:54.816582 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:54.818179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:54.830548 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1466/2882] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:30:54.834794 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.844210 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96116e07-2206-42e5-ba84-04552fd341d7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.848771 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.849362 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.849635 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.849903 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.850510 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:54.852396 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:54.879437 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1417/2883] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:30:54 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:30:54.883586 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.894773 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3330900-ba40-4e8d-b72a-9dae907757e1 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.952241 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.952863 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.953140 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.953409 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.954024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:54.955921 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:54.976778 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1467/2884] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:30:54 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:30:54.981112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:54.992089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8cf97-5321-4d98-aec0-bd27b87bff82 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:54.996658 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:54.997985 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:54.998115 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:54.998358 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:54.998992 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:55.000606 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:55.010289 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1418/2885] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:30:55.014702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:55.025068 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036ef16-b724-451e-824c-3eba649e56ee admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:55.030276 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625255db-24d9-4bab-86ce-e4ef969805c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:55.030872 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625255db-24d9-4bab-86ce-e4ef969805c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:55.031150 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625255db-24d9-4bab-86ce-e4ef969805c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:55.031420 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625255db-24d9-4bab-86ce-e4ef969805c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:55.032050 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625255db-24d9-4bab-86ce-e4ef969805c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:55.033660 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625255db-24d9-4bab-86ce-e4ef969805c0 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:55.045330 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1468/2886] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:30:55.049483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:55.060220 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f57-9400-4c8a-acc7-6038e0741ac0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:55.065089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:55.065746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:55.066028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:55.066302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] PATH_INFO: `/v3/projects/fad55dd62d9a43e196b4c5832e315806/users/c54e2de4440b42999fbdf588fe26e192/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:55.080808 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad55dd62d9a43e196b4c5832e315806, user_id=c54e2de4440b42999fbdf588fe26e192, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:55.083441 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:55.095815 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1419/2887] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:30:55 2022] PUT /identity/v3/projects/fad55dd62d9a43e196b4c5832e315806/users/c54e2de4440b42999fbdf588fe26e192/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:30:55.108494 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:55.108805 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:55.109069 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:55.136407 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] MFA Rules not processed for user `c54e2de4440b42999fbdf588fe26e192`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:55.137884 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:55.201218 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1469/2888] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:30:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:55.212511 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:55.214303 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:55.235931 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:55.272462 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3560-de07-4947-b0b0-4943f12ea4d2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:55.276032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1892c6-7c14-436f-834a-954f0f7f8bcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ab184b2ae0437d9fb01eac225baf06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:55.276755 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1892c6-7c14-436f-834a-954f0f7f8bcc service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:55.277030 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1892c6-7c14-436f-834a-954f0f7f8bcc service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:55.277295 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1892c6-7c14-436f-834a-954f0f7f8bcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:55.285809 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1892c6-7c14-436f-834a-954f0f7f8bcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:55.287469 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1892c6-7c14-436f-834a-954f0f7f8bcc service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:55.296937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1420/2889] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:05.198283 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:05.292399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=17 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:23.339920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:23.402099 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2473c5c-6f38-4400-a892-cc548b7ef920 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:23.407279 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:23.407899 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:23.408179 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:23.408452 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] PATH_INFO: `/v3/users/c54e2de4440b42999fbdf588fe26e192` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:23.409601 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54e2de4440b42999fbdf588fe26e192)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:23.411523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:23.457497 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54e2de4440b42999fbdf588fe26e192'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:23.464178 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54e2de4440b42999fbdf588fe26e192'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:23.464861 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54e2de4440b42999fbdf588fe26e192'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:23.465483 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54e2de4440b42999fbdf588fe26e192'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:23.472477 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54e2de4440b42999fbdf588fe26e192'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:23.489324 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1470/2890] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:23 2022] DELETE /identity/v3/users/c54e2de4440b42999fbdf588fe26e192 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:23.493937 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:23.494418 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:23.494538 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:23.512949 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:23.515214 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:23.574660 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1421/2891] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:23.585154 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:23.586581 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:23.642877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f668e2-e6d4-4f58-9cec-27fb4399702f admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:23.646529 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91168610-a3cd-4df8-9f8d-b43b80d2ae4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:23.647129 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168610-a3cd-4df8-9f8d-b43b80d2ae4d service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:23.647406 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168610-a3cd-4df8-9f8d-b43b80d2ae4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:23.647679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168610-a3cd-4df8-9f8d-b43b80d2ae4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:23.657262 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91168610-a3cd-4df8-9f8d-b43b80d2ae4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:23.658673 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91168610-a3cd-4df8-9f8d-b43b80d2ae4d service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:23.668215 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1471/2892] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:23.935859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:23.938089 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:23.950173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b74cd9-f473-4cf4-9a13-70757da93eee None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:23.955707 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:23.956334 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:23.956636 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:23.956905 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] PATH_INFO: `/v3/projects/fad55dd62d9a43e196b4c5832e315806` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:23.958006 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad55dd62d9a43e196b4c5832e315806)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:23.959920 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.006435 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad55dd62d9a43e196b4c5832e315806', 'request_id': 'req-4b193a78-72b0-4396-9a34-910b0cfdb4a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:24.011842 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad55dd62d9a43e196b4c5832e315806', 'request_id': 'req-4b193a78-72b0-4396-9a34-910b0cfdb4a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:24.019353 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad55dd62d9a43e196b4c5832e315806', 'request_id': 'req-4b193a78-72b0-4396-9a34-910b0cfdb4a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:24.030413 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] The token cache is being invalidate because project fad55dd62d9a43e196b4c5832e315806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:24.030703 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:24.031336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4b193a78-72b0-4396-9a34-910b0cfdb4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:24.032806 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1422/2893] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:23 2022] DELETE /identity/v3/projects/fad55dd62d9a43e196b4c5832e315806 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:24.037738 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.038014 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.038280 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.058093 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:24.059329 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:24.076333 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:24.120485 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1472/2894] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:24.128951 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.129236 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.129513 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.149241 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:24.150447 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:24.158464 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1423/2895] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:24.162624 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.173030 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec50b3-2d89-4833-8de2-c4719be706b0 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.177536 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.178144 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.178419 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.178684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] PATH_INFO: `/v3/domains` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.179315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80166) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:24.179609 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.181211 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.192978 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1473/2896] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:24.197350 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.207044 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc562cc-fa8d-4a27-87b3-e43b8be3bc3c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.211715 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.212304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.212638 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.212913 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.213537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.215455 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.242706 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1424/2897] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:24 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:24.246934 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.257368 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c459f-2839-4b9b-82e6-36c840b2003a admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.311892 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.312542 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.312844 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.313110 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.313722 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.315634 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.335558 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1474/2898] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:24 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:24.339643 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.350111 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d1ce-1494-4235-b2f2-ebf49d94b691 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.354662 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.355249 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.355524 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.355795 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.356424 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.358598 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.368892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1425/2899] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:24.372800 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.383835 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d96e6c-faf0-4a27-bf20-61fdde44b3e2 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.388625 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8af1-1255-47a1-9b91-6c77b5cca723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.389244 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8af1-1255-47a1-9b91-6c77b5cca723 admin admin] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.390016 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8af1-1255-47a1-9b91-6c77b5cca723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.390296 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8af1-1255-47a1-9b91-6c77b5cca723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.390929 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8af1-1255-47a1-9b91-6c77b5cca723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.392514 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8af1-1255-47a1-9b91-6c77b5cca723 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.404091 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1475/2900] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:24.408277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.418548 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dba5-98a9-469a-b609-36fcafcc8c76 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.423838 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.424477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.424781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.425049 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] PATH_INFO: `/v3/projects/0ef593d02c1b45bf9d200a7633d8c30b/users/7e7e1a2cd7c9465db3dc0c314a8f1148/roles/7969717fb22c46249a430b8bd7e844c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.440322 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef593d02c1b45bf9d200a7633d8c30b, user_id=7e7e1a2cd7c9465db3dc0c314a8f1148, role_id=7969717fb22c46249a430b8bd7e844c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.442974 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.455863 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1426/2901] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:24 2022] PUT /identity/v3/projects/0ef593d02c1b45bf9d200a7633d8c30b/users/7e7e1a2cd7c9465db3dc0c314a8f1148/roles/7969717fb22c46249a430b8bd7e844c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:24.466082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] REQUEST_METHOD: `POST` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.466367 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.466677 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.495608 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.auth.core [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] MFA Rules not processed for user `7e7e1a2cd7c9465db3dc0c314a8f1148`. Rule list: `[]` (Enabled: `True`). {{(pid=80166) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:24.496864 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:24.563153 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1476/2902] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:31:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:24.574302 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:24.576032 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:24.598169 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:24.634672 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6d08-d069-4fee-aa1b-e95785de1ae6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:24.638385 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456dc59-9057-46e8-a4d4-caf91f88d05f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab6c2c2f06040d09952c23e76d2c8b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:24.638956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456dc59-9057-46e8-a4d4-caf91f88d05f service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:24.639280 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456dc59-9057-46e8-a4d4-caf91f88d05f service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:24.639551 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456dc59-9057-46e8-a4d4-caf91f88d05f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:24.647827 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456dc59-9057-46e8-a4d4-caf91f88d05f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:24.649273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456dc59-9057-46e8-a4d4-caf91f88d05f service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:24.658394 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1427/2903] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:29.640186 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:29.659994 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:29.703839 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69ad2-3ebc-4074-955f-ba3a0f9a3430 None None] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:29.709212 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:29.709834 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:29.710109 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:29.710381 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] PATH_INFO: `/v3/users/7e7e1a2cd7c9465db3dc0c314a8f1148` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:29.711476 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7e1a2cd7c9465db3dc0c314a8f1148)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:29.713394 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:29.759000 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7e1a2cd7c9465db3dc0c314a8f1148'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:29.765679 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7e1a2cd7c9465db3dc0c314a8f1148'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:29.766353 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7e1a2cd7c9465db3dc0c314a8f1148'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:29.766948 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7e1a2cd7c9465db3dc0c314a8f1148'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:29.774702 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7e1a2cd7c9465db3dc0c314a8f1148'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:29.792082 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1477/2904] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:29 2022] DELETE /identity/v3/users/7e7e1a2cd7c9465db3dc0c314a8f1148 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:29.796735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:29.797190 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:29.797327 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:29.816686 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] MFA Rules not processed for user `7138c103c58f4e61a09c656d5711ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:29.817875 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:29.875290 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1428/2905] 10.222.0.25 () {58 vars in 958 bytes} [Sun Aug 7 18:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:29.885790 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:29.887193 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:29.945523 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6ff2-a981-48a2-94c4-9dbd41bce7e7 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:29.949155 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:29.949748 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:29.950024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:29.950294 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:29.960006 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:29.961454 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:29.970930 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1478/2906] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:30.235689 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.237922 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:30.250363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69936323-0f80-48d9-ab83-2556e1601a16 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:30.255897 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:30.256525 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.256826 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.257096 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] PATH_INFO: `/v3/projects/0ef593d02c1b45bf9d200a7633d8c30b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.258193 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef593d02c1b45bf9d200a7633d8c30b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:30.260078 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:30.307086 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef593d02c1b45bf9d200a7633d8c30b', 'request_id': 'req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.312399 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef593d02c1b45bf9d200a7633d8c30b', 'request_id': 'req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.320173 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef593d02c1b45bf9d200a7633d8c30b', 'request_id': 'req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.331450 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] The token cache is being invalidate because project 0ef593d02c1b45bf9d200a7633d8c30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:30.331735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.332361 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.334101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1429/2907] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:30 2022] DELETE /identity/v3/projects/0ef593d02c1b45bf9d200a7633d8c30b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:39.966577 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:40.328126 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:01.238882 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:01.247708 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453f1e-0664-422e-8074-78bba89c7ce7 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:01.299445 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:01.300055 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:01.300331 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:01.300633 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:01.302408 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:01.311960 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:01.313414 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:01.321766 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1479/2908] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:01.420165 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:01.422260 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:01.435299 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8a18-629c-4cf1-9dc7-5b8f57bcf00f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:01.438989 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:01.439576 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:01.439868 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:01.440257 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:01.442273 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:01.512700 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:01.514139 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:01.526915 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1430/2909] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:01.587794 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:01.589206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:01.658730 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2a4f9-6df9-4468-b64f-aeeae138af35 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:01.663676 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:01.664268 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:01.664546 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:01.664845 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:01.666767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:01.678205 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:01.680287 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:01.690327 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1480/2910] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:02.589668 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:02.591112 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:02.611773 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae288e4-305d-475f-bd62-86cb0fcc65f2 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:02.615261 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:02.615981 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:02.616355 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:02.616757 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:02.626953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:02.645405 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:02.647315 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:02.667371 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1431/2911] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:11.685936 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=58 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:12.657059 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=40 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:13.782885 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:13.784356 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:13.799405 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab508bc-38a4-428b-9876-f740930a0966 service placement] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:13.804767 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:13.805374 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:13.805645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:13.805908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:13.807619 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:13.819642 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:13.821265 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:13.831224 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1481/2912] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:34:23.826804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=6 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:56.609891 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:56.619155 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42d79-fa3c-4534-ae16-bdb9d5090647 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:56.622657 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:56.623240 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:56.623514 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:56.623781 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:56.625460 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:56.682892 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:56.684304 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:56.693483 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1432/2913] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:34:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:34:57.535745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:57.550360 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c035d6-e011-47fa-ae82-dda73f73c34e service placement] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:57.556645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:57.557254 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:57.557533 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:57.557806 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:57.559908 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:57.573587 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:57.575174 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:57.587504 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1482/2914] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:34:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:35:00.042650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:00.055747 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c3fa0-9423-48a0-802b-9735f76d98ab service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:00.062308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '099e4db05ff34c9bad67022f4484c108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:00.063027 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:00.063308 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:00.063716 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:00.065768 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:00.079477 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:00.081650 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:00.093569 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1433/2915] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:35:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:35:02.422314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:02.424222 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:02.435579 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76481fa-bfee-48b2-a984-845302f0dd83 service nova] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:02.439080 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15c36ce12e5b4f25848137a9dc590f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:02.440320 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:02.440617 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:02.440889 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:02.442545 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:02.505868 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:02.507298 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:02.516831 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1483/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:35:05.651982 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:05.673534 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eabcf-021b-4f75-b348-2809ecb0a569 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:05.680995 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:05.681870 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:05.682354 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:05.682956 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:05.685434 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:05.703859 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:05.705840 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:05.718718 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1434/2917] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:35:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:35:08.942387 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:08.943877 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:08.956315 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c9569-c430-48f8-9d80-c49c2ac04cf0 service neutron] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:08.960780 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:08.961399 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:08.961671 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:08.961939 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] PATH_INFO: `/v3/users/ba55045d1d164aed91798fead37c9817` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:08.963067 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba55045d1d164aed91798fead37c9817)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:08.965021 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:09.015024 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba55045d1d164aed91798fead37c9817'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.023249 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba55045d1d164aed91798fead37c9817'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.023931 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba55045d1d164aed91798fead37c9817'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.024590 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba55045d1d164aed91798fead37c9817'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.031804 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba55045d1d164aed91798fead37c9817'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.050378 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1484/2918] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:35:08 2022] DELETE /identity/v3/users/ba55045d1d164aed91798fead37c9817 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:35:09.224277 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:09.239616 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a180a-cb52-463d-9ed9-4e5f8d4a20ef service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:09.305746 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:09.306363 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:09.306641 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:09.306935 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] PATH_INFO: `/v3/projects/c3619a63d25b487a8a0866e8f5fe88a4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:09.308028 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3619a63d25b487a8a0866e8f5fe88a4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:09.309932 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:09.355767 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3619a63d25b487a8a0866e8f5fe88a4', 'request_id': 'req-0520400e-51a7-4af6-b8cc-b89b7cbda192'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.361069 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3619a63d25b487a8a0866e8f5fe88a4', 'request_id': 'req-0520400e-51a7-4af6-b8cc-b89b7cbda192'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.367966 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3619a63d25b487a8a0866e8f5fe88a4', 'request_id': 'req-0520400e-51a7-4af6-b8cc-b89b7cbda192'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.379735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] The token cache is being invalidate because project c3619a63d25b487a8a0866e8f5fe88a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:35:09.380018 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.380684 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.382176 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1435/2919] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:35:09 2022] DELETE /identity/v3/projects/c3619a63d25b487a8a0866e8f5fe88a4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:35:09.386125 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:09.387562 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:09.401398 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e21497-23a4-47b6-84cf-1ed9672380dc admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:09.448314 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:35:09.459689 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:09.460334 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:09.460645 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:09.460920 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] PATH_INFO: `/v3/users/e8f32d7b5be24762b530b3f65d26b030` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:09.462063 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f32d7b5be24762b530b3f65d26b030)` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:09.464004 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:09.511048 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f32d7b5be24762b530b3f65d26b030'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.518907 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f32d7b5be24762b530b3f65d26b030'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.519568 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f32d7b5be24762b530b3f65d26b030'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.520172 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f32d7b5be24762b530b3f65d26b030'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.527073 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.notifications [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f32d7b5be24762b530b3f65d26b030'} {{(pid=80166) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.544837 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1485/2920] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Aug 7 18:35:09 2022] DELETE /identity/v3/users/e8f32d7b5be24762b530b3f65d26b030 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:35:09.719107 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:09.721735 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:09.729537 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:35:09.734833 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520400e-51a7-4af6-b8cc-b89b7cbda192 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:09.797456 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7138c103c58f4e61a09c656d5711ef37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab45c72f2c8847f1ab2e5e2de581c89e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:09.798101 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:09.798382 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:09.799224 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] PATH_INFO: `/v3/projects/8c50bf3d8f504365a4c7f4ce1168a6a9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:09.800885 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c50bf3d8f504365a4c7f4ce1168a6a9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:09.803004 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:09.849512 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c50bf3d8f504365a4c7f4ce1168a6a9', 'request_id': 'req-ad61419b-515b-4a39-87ea-7a1704b82e6d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.854955 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c50bf3d8f504365a4c7f4ce1168a6a9', 'request_id': 'req-ad61419b-515b-4a39-87ea-7a1704b82e6d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.862655 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c50bf3d8f504365a4c7f4ce1168a6a9', 'request_id': 'req-ad61419b-515b-4a39-87ea-7a1704b82e6d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.874054 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] The token cache is being invalidate because project 8c50bf3d8f504365a4c7f4ce1168a6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:35:09.874336 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.874953 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-ad61419b-515b-4a39-87ea-7a1704b82e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:09.876412 dv-cinder-849846-9-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1436/2921] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Aug 7 18:35:09 2022] DELETE /identity/v3/projects/8c50bf3d8f504365a4c7f4ce1168a6a9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:35:19.541478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:35:19.871074 dv-cinder-849846-9-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:39:16.775574 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Authenticating user token {{(pid=80166) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:39:16.776991 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:39:16.920429 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f306-bd7b-4f22-adb9-12f885d3fb04 admin admin] Validating token access rules against request {{(pid=80166) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:39:16.978684 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a8c8efd39f14b65984c0d2a8782e48e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3cceea278344db49b58367c7f0b8156', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80166) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:39:16.979206 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] REQUEST_METHOD: `GET` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:39:16.979478 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] SCRIPT_NAME: `/identity` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:39:16.979745 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80166) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:39:16.981502 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.fernet_utils [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80166) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:39:16.993219 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:39:16.994763 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f03fe1-2edc-4f3e-84e2-1c947a5ef750 service placement] RBAC: Authorization granted {{(pid=80166) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:39:17.004828 dv-cinder-849846-9-smb devstack@keystone.service[80166]: [pid: 80166|app: 0|req: 1486/2922] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Aug 7 18:39:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:39:27.000286 dv-cinder-849846-9-smb devstack@keystone.service[80166]: DEBUG dbcounter [-] [80166] Writing DB stats keystone:SELECT=89 {{(pid=80166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}